00000001:02000400:3.0F:1787602251.784829:0:2967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing set_hostid 00000001:02000400:3.0:1787602268.202639:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787602269.959755:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 567 MB/s 00000001:01000000:2.0:1787602270.209331:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1155 MB/s 00000001:01000000:2.0:1787602270.459693:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6095 MB/s 00000020:02000000:3.0:1787602271.245229:0:3280:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_82_gfc0532e 00000400:02000000:0.0F:1787602271.991624:0:3295:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.125@tcp [8/256/0/180] 00008000:02000000:3.0:1787602275.583647:0:3444:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1787602317.855119:0:5243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787602326.935487:0:5813:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787602326.935493:0:5813:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787602326.935627:0:5813:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002aede1bc 00000080:02000400:3.0:1787602326.935637:0:5813:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787602326.945583:0:5813:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787602326.945597:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787602326.946572:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a46dc2ac) 00000020:00000080:0.0:1787602326.946594:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787602326.973071:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787602326.973672:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787602327.000025:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787602327.000999:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787602327.001022:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787602327.001160:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787602327.001185:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787602327.002215:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787602327.002223:0:5813:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787602327.002239:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af4653e 00000020:01000004:1.0:1787602327.002247:0:5813:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787602327.002251:0:5813:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787602327.002256:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002aede1bc from MGS 00000020:01000004:1.0:1787602327.002260:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787602327.002281:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000538b0b84) 00000020:00000080:1.0:1787602327.002292:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787602327.002397:0:5813:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002aede1bc from MGS, refs=2 00080000:01000000:1.0:1787602327.002402:0:5813:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787602327.002407:0:5813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af4654c 00000100:00100000:1.0:1787602327.002535:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787602327.002685:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787602327.002699:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787602327.003764:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787602327.003773:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787602327.004681:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602327.005146:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787602327.005152:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787602327.005992:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787602327.006001:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787602327.006458:0:5813:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787602327.006466:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787602327.007510:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602327.007514:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602327.007516:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602327.007984:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602327.007987:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602327.007988:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602327.010597:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787602327.018426:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787602327.260275:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2259 MB/s 00000001:01000000:0.0:1787602327.510078:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3219 MB/s 00000001:01000000:1.0:1787602327.760572:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 611 MB/s 00000001:01000000:2.0:1787602328.012704:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 714 MB/s 00080000:10000000:3.0:1787602328.027868:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1787602328.029242:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787602328.040873:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787602328.040889:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787602328.040891:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787602328.048545:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787602328.048694:0:5813:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787602328.048747:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787602328.048988:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787602328.049021:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787602328.050166:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602328.050361:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787602328.050368:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787602328.051986:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787602328.051996:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787602328.052418:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787602328.052443:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787602328.055952:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787602328.055977:0:5813:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.125@tcp' 00000020:01000004:1.0:1787602328.055979:0:5813:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787602328.056032:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.125@tcp (typ=mgc) 00000100:00080000:2.0:1787602328.058072:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787602328.059373:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.125@tcp (00000000edc3354d) 00000020:00000080:2.0:1787602328.059406:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787602328.059560:0:5813:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002e2cd828@MGC192.168.206.125@tcp: add connection 192.168.206.125@tcp at head 00010000:00010000:2.0:1787602328.059933:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.125@tcp-0 is initialized 00000040:01000000:2.0:1787602328.059941:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.125@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787602328.062909:0:5830:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787602328.064239:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.125@tcp (uuid c5c99bea-fdac-431e-b440-876dfd3e206e) 00000020:00000080:2.0:1787602328.064271:0:5813:0:(genops.c:1385:class_connect()) connect: client c5c99bea-fdac-431e-b440-876dfd3e206e, cookie 0x576b7af90af4655a 00000100:00080000:2.0:1787602328.064286:0:5813:0:(import.c:510:import_select_connection()) MGC192.168.206.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787602328.064292:0:5813:0:(import.c:624:import_select_connection()) MGC192.168.206.125@tcp: import 000000002e2cd828 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:2.0:1787602328.064355:0:5813:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ab7e87ab x1874436838916224/t0(0) o250->MGC192.168.206.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787602328.064381:0:5813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c5c99bea-fdac-431e-b440-876dfd3e206e->MGS 00000020:01000004:2.0:1787602328.064409:0:5813:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787602328.064433:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787602328.064450:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c2acb526) 00000020:00000080:2.0:1787602328.064463:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787602328.066444:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab7e87ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5c99bea-fdac-431e-b440-876dfd3e206e:3310:1874436838916224:0@lo:250: 00000100:00100000:1.0:1787602328.066575:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602328.067173:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838916224 00000100:00100000:3.0:1787602328.067189:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838916224 00000100:00100000:3.0:1787602328.067268:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602328.067692:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000581ddfa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874436838916224:12345-0@lo:250: 00010000:00080000:3.0:1787602328.067726:0:5826:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c5c99bea-fdac-431e-b440-876dfd3e206e@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:3.0:1787602328.067762:0:5826:0:(genops.c:1385:class_connect()) connect: client c5c99bea-fdac-431e-b440-876dfd3e206e, cookie 0x576b7af90af46568 00000100:00080000:3.0:1787602328.067906:0:5826:0:(import.c:65:import_set_state_nolock()) 000000001da2bcc6 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602328.068018:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000581ddfa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+5:3310:x1874436838916224:12345-0@lo:250: Request processed in 735us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602328.068027:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602328.068280:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787602328.068296:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.125@tcp: connect to target with instance 0 00000100:00080000:1.0:1787602328.068305:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787602328.068312:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787602328.068326:0:3310:0:(import.c:65:import_set_state_nolock()) 000000002e2cd828 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787602328.068331:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787602328.068352:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787602328.068361:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab7e87ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5c99bea-fdac-431e-b440-876dfd3e206e:3310:1874436838916224:0@lo:250: 00000100:00100000:3.0:1787602328.077736:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602328.077972:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787602328.077979:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787602328.082135:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787602328.082149:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787602328.084571:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787602328.084594:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787602328.089232:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602328.089450:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787602328.089457:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787602328.090729:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787602328.090740:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787602328.131616:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602328.131856:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787602328.131865:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787602328.133186:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787602328.133205:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787602328.133972:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602328.134464:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787602328.134471:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787602328.134984:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787602328.135001:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787602328.135633:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602328.135794:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787602328.135799:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787602328.136575:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787602328.136584:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787602328.137365:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602328.137579:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787602328.137586:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787602328.138172:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787602328.138179:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787602328.170964:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602328.172849:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787602328.172953:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787602328.178559:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787602328.178579:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787602328.179990:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787602328.180003:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787602328.182670:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787602328.182703:0:5813:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787602328.182711:0:5813:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787602328.182884:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787602328.182920:0:5813:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.125@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787602328.182925:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787602328.182927:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602328.182928:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602328.182933:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602328.182934:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602328.182935:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602328.182936:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602328.182938:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602328.182939:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602328.182940:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602328.182942:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602328.182944:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787602328.182946:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787602328.182947:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787602328.182948:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602328.182949:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602328.182950:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602328.182951:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602328.182952:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602328.182953:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602328.182953:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602328.182954:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602328.182955:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602328.182956:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602328.182957:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787602328.183000:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787602328.183031:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c082e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916352:0@lo:253: 00000100:00100000:3.0:1787602328.183158:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602328.183232:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d15df608 going to sleep for 11 seconds 00000100:00100000:1.0:1787602328.183592:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838916352 00000100:00100000:1.0:1787602328.183603:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838916352 00000100:00100000:1.0:1787602328.183668:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602328.183679:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000447eba7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+5:5813:x1874436838916352:12345-0@lo:253: 20000000:01000000:1.0:1787602328.183735:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787602328.183738:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787602328.184317:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787602328.184452:0:5828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787602328.184790:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602328.186448:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787602328.186831:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787602328.186836:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787602328.186844:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787602328.186848:0:5828:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787602328.186879:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787602328.187194:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602328.187501:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787602328.187516:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787602328.187570:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787602328.187619:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787602328.188224:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787602328.188432:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787602328.188443:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787602328.188499:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787602328.188507:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787602328.188538:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787602328.188545:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787602328.188592:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787602328.188640:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787602328.188814:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787602328.188820:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787602328.188833:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602328.189634:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787602328.190742:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787602328.190839:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787602328.190875:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787602328.190967:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787602328.190984:0:5828:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787602328.191533:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787602328.191545:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787602328.191663:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787602328.191704:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787602328.191747:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787602328.191759:0:5828:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787602328.191851:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787602328.191879:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787602328.191912:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787602328.191941:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787602328.193554:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787602328.193664:0:5828:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787602328.193675:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787602328.194409:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787602328.194849:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787602328.194882:0:5828:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.125@tcp for mdt 20000000:01000000:1.0:1787602328.194885:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787602328.194924:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787602328.194933:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787602328.194975:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787602328.194983:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.125@tcp (null) (null) 00000040:00080000:1.0:1787602328.195270:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787602328.195284:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787602328.195392:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787602328.195444:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787602328.195526:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787602328.195530:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787602328.195534:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787602328.195547:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787602328.195551:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787602328.195583:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787602328.195585:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787602328.198817:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787602328.199489:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787602328.199546:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787602328.199582:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1787602328.199597:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787602328.199600:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787602328.201555:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787602328.202239:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787602328.202505:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787602328.202635:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1787602328.203144:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787602328.203148:0:5828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787602328.203154:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787602328.203165:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787602328.203172:0:5828:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787602328.203180:0:5828:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787602328.212924:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787602328.213518:0:5828:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787602328.224757:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787602328.224814:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787602328.224900:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787602328.224926:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787602328.224950:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602328.224972:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602328.224984:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602328.224991:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602328.224997:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602328.225005:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602328.225023:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002467572b already unused, calling callback (00000000f2ae3209) 00010000:00010000:0.0:1787602328.225028:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602328.225094:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602328.225109:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602328.225116:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602328.225121:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002467572b/0x576b7af90af4656f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787602328.225139:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787602328.511084:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000447eba7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+5:5813:x1874436838916352:12345-0@lo:253: Request processed in 327398us (327918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602328.511107:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787602328.511350:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c082e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916352:0@lo:253: 10000000:01000000:3.0:1787602328.511370:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787602328.511373:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787602328.511375:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602328.511376:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602328.511378:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787602328.511379:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602328.511380:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602328.511382:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602328.511383:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602328.511385:0:5813:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787602328.511386:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602328.511388:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787602328.511408:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002aede1bc from lustre-MDT0000 10000000:01000000:3.0:1787602328.511447:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787602328.511450:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787602328.511455:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff944a4560cd28 10000000:01000000:3.0:1787602328.511460:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787602328.511468:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff944a4560cd28 from 1 10000000:01000000:3.0:1787602328.511471:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787602328.511509:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: 00000000f5f96ba6/0x576b7af90af46576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602328.511520:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: 00000000f5f96ba6/0x576b7af90af46576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602328.511529:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: 00000000f5f96ba6/0x576b7af90af46576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602328.511564:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c082e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916480:0@lo:101: 00000100:00100000:3.0:1787602328.511683:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602328.511773:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838916480 00000100:00100000:1.0:1787602328.511781:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838916480 00000100:00100000:1.0:1787602328.511822:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602328.511829:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bef967c2 going to sleep for 11 seconds 00000100:00100000:1.0:1787602328.511830:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7467aac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+5:5813:x1874436838916480:12345-0@lo:101: 00010000:00010000:1.0:1787602328.511844:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602328.511859:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000284ab508/0x576b7af90af4657d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46576 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602328.511884:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000284ab508/0x576b7af90af4657d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46576 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602328.511894:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000284ab508/0x576b7af90af4657d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46576 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602328.511904:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000284ab508, rc 0) 00000100:00100000:1.0:1787602328.514434:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7467aac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+6:5813:x1874436838916480:12345-0@lo:101: Request processed in 2348us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602328.514462:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602328.514571:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c082e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916480:0@lo:101: 00010000:00010000:3.0:1787602328.514736:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: 00000000f5f96ba6/0x576b7af90af46576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602328.514750:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: 00000000f5f96ba6/0x576b7af90af46576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602328.514841:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c082e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916608:0@lo:501: 00000100:00100000:3.0:1787602328.514899:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602328.514943:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bef967c2 going to sleep for 11 seconds 00000100:00100000:0.0:1787602328.515716:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838916608 00000100:00100000:0.0:1787602328.515726:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838916608 00000100:00100000:0.0:1787602328.515776:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787602328.515784:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae736a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+6:5813:x1874436838916608:12345-0@lo:501: 00000100:00100000:0.0:1787602328.516468:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae736a61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+6:5813:x1874436838916608:12345-0@lo:501: Request processed in 682us (1567us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787602328.516477:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787602328.516755:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c082e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916608:0@lo:501: 10000000:01000000:3.0:1787602328.516902:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787602328.516973:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: 00000000f5f96ba6/0x576b7af90af46576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602328.516984:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: 00000000f5f96ba6/0x576b7af90af46576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602328.516994:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff944a487a1000 10000000:01000000:3.0:1787602328.517000:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787602328.517005:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff944a487a1000 10000000:01000000:3.0:1787602328.517008:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787602328.517011:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff944a487a1000 from 1 10000000:01000000:3.0:1787602328.517014:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787602328.517067:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: 000000002a23d6d8/0x576b7af90af46584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602328.517087:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: 000000002a23d6d8/0x576b7af90af46584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602328.517096:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: 000000002a23d6d8/0x576b7af90af46584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602328.517116:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c082e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916736:0@lo:101: 00000100:00100000:3.0:1787602328.517163:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602328.517219:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013a858b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602328.517411:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838916736 00000100:00100000:1.0:1787602328.517418:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838916736 00000100:00100000:1.0:1787602328.517471:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602328.517480:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000653ab6dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+6:5813:x1874436838916736:12345-0@lo:101: 00010000:00010000:1.0:1787602328.517492:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602328.517506:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000944279e4/0x576b7af90af4658b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46584 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602328.517530:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000944279e4/0x576b7af90af4658b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46584 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602328.517538:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000944279e4/0x576b7af90af4658b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46584 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602328.517546:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000944279e4, rc 0) 00000100:00100000:1.0:1787602328.517755:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000653ab6dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+7:5813:x1874436838916736:12345-0@lo:101: Request processed in 275us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602328.517762:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602328.517947:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c082e80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916736:0@lo:101: 00010000:00010000:2.0:1787602328.517962:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: 000000002a23d6d8/0x576b7af90af46584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602328.517980:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: 000000002a23d6d8/0x576b7af90af46584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602328.517995:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787602328.518275:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: 000000002a23d6d8/0x576b7af90af46584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602328.518292:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: 000000002a23d6d8/0x576b7af90af46584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602328.518299:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787602328.518444:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787602328.518451:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff944a487a1000 10000000:01000000:3.0:1787602328.518454:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787602328.518457:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787602328.518459:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787602328.518484:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: 000000003699c7e9/0x576b7af90af46592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602328.518491:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: 000000003699c7e9/0x576b7af90af46592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602328.518498:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: 000000003699c7e9/0x576b7af90af46592 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602328.518512:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b693021 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916864:0@lo:101: 00000100:00100000:3.0:1787602328.518553:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602328.518587:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e979a06 going to sleep for 11 seconds 00000100:00100000:1.0:1787602328.518714:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838916864 00000100:00100000:1.0:1787602328.518721:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838916864 00000100:00100000:1.0:1787602328.518760:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602328.518768:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f966659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+7:5813:x1874436838916864:12345-0@lo:101: 00010000:00010000:1.0:1787602328.518780:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602328.518791:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c13563cb/0x576b7af90af46599 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46592 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602328.518809:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c13563cb/0x576b7af90af46599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46592 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602328.518828:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c13563cb/0x576b7af90af46599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46592 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602328.518835:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c13563cb, rc 0) 00000100:00100000:1.0:1787602328.518882:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f966659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+8:5813:x1874436838916864:12345-0@lo:101: Request processed in 114us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602328.518889:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787602328.519102:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b693021 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916864:0@lo:101: 00010000:00010000:2.0:1787602328.519114:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: 000000003699c7e9/0x576b7af90af46592 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602328.519122:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: 000000003699c7e9/0x576b7af90af46592 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602328.519176:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d093e6c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916992:0@lo:501: 00000100:00100000:2.0:1787602328.519226:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602328.519480:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da716198 going to sleep for 11 seconds 00000100:00100000:1.0:1787602328.519697:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838916992 00000100:00100000:1.0:1787602328.519703:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838916992 00000100:00100000:1.0:1787602328.519773:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602328.519780:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a0bcd6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+8:5813:x1874436838916992:12345-0@lo:501: 00000100:00100000:1.0:1787602328.520137:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a0bcd6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+9:5813:x1874436838916992:12345-0@lo:501: Request processed in 357us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602328.520145:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787602328.520500:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d093e6c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838916992:0@lo:501: 00000100:00100000:3.0:1787602328.520689:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838917120:0@lo:503: 00000100:00100000:3.0:1787602328.520740:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602328.520783:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e80634c going to sleep for 11 seconds 00000100:00100000:0.0:1787602328.520841:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838917120 00000100:00100000:0.0:1787602328.520846:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838917120 00000100:00100000:0.0:1787602328.520885:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787602328.520893:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e073627f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+9:5813:x1874436838917120:12345-0@lo:503: 00000100:00100000:0.0:1787602328.521092:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e073627f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+9:5813:x1874436838917120:12345-0@lo:503: Request processed in 200us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602328.521105:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787602328.521431:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838917120:0@lo:503: 00000100:00100000:3.0:1787602328.521873:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:5856:1874436838917248:0@lo:502: 00000100:00100000:3.0:1787602328.521921:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602328.521957:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e0714b6 going to sleep for 11 seconds 00000100:00100000:0.0:1787602328.522012:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838917248 00000100:00100000:0.0:1787602328.522018:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838917248 00000100:00100000:0.0:1787602328.522074:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787602328.522082:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1c20c0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+9:5856:x1874436838917248:12345-0@lo:502: 00000100:00100000:0.0:1787602328.522298:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1c20c0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+9:5856:x1874436838917248:12345-0@lo:502: Request processed in 217us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602328.522306:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602328.522677:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:5856:1874436838917248:0@lo:502: 00000020:01000000:3.0:1787602328.522706:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602328.522718:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602328.522720:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787602328.522725:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787602328.522728:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787602328.522752:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e2692ff3) 00000020:00000080:3.0:1787602328.522771:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787602328.522778:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787602328.522889:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787602328.522907:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af465a7 00000020:00000080:3.0:1787602328.523159:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787602328.523163:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602328.523167:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602328.523168:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787602328.523171:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602328.523174:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602328.523175:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787602328.523178:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787602328.523439:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001daeaf5b) 00000020:00000080:3.0:1787602328.523452:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787602328.523458:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787602328.523460:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787602328.523462:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787602328.523468:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787602328.523521:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002aede1bc from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787602328.523547:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b2f6b1ab) 00000020:00000080:3.0:1787602328.523556:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787602328.523748:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787602328.523755:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x576b7af90af465bc 00000020:00000080:3.0:1787602328.523855:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787602328.523861:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787602328.523865:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x576b7af90af465c3 00080000:01000000:3.0:1787602328.523871:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787602328.523874:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af465ca 00080000:10000000:3.0:1787602328.524494:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787602328.524804:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787602328.530522:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787602328.643557:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787602328.643891:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787602328.648032:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787602328.648497:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787602328.689998:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ff966990) 00000020:00000080:0.0:1787602328.690022:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787602328.690450:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787602328.690458:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af465d8 00000020:00000080:0.0:1787602328.692085:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787602328.693401:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602328.759958:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602328.806708:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602328.893576:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602328.953985:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787602328.990596:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787602329.024883:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x576b7af90af465df 00000020:00000080:1.0:1787602329.025710:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787602329.025723:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602329.025729:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602329.025732:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787602329.025735:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602329.025739:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602329.025740:0:5856:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787602329.025742:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787602329.025744:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787602329.025746:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602329.025748:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602329.025749:0:5856:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787602329.025751:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602329.025755:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602329.025762:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787602329.025766:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787602329.025809:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787602329.025879:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d6329a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:5856:1874436838917376:0@lo:502: 00000100:00100000:1.0:1787602329.025961:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602329.026026:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8288fd4 going to sleep for 11 seconds 00000100:00100000:3.0:1787602329.027027:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838917376 00000100:00100000:3.0:1787602329.027067:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838917376 00000100:00100000:3.0:1787602329.027172:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787602329.027182:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007a14422 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+9:5856:x1874436838917376:12345-0@lo:502: 00000100:00100000:3.0:1787602329.027705:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007a14422 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+9:5856:x1874436838917376:12345-0@lo:502: Request processed in 524us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602329.027714:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602329.028221:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d6329a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:5856:1874436838917376:0@lo:502: 00000020:01000000:1.0:1787602329.028254:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602329.028261:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602329.028264:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787602329.028267:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787602329.028623:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787602329.028645:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787602329.028701:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: 000000003699c7e9/0x576b7af90af46592 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602329.028713:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: 000000003699c7e9/0x576b7af90af46592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602329.028722:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff944a487a1000 from 1 10000000:01000000:0.0:1787602329.028725:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787602329.028774:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602329.028796:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602329.028805:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602329.028824:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7150341 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838917504:0@lo:101: 00000100:00100000:0.0:1787602329.028874:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602329.028947:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e45994d going to sleep for 11 seconds 00000100:00100000:1.0:1787602329.029182:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838917504 00000100:00100000:1.0:1787602329.029190:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838917504 00000100:00100000:1.0:1787602329.029232:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787602329.029240:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3b04f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+9:5813:x1874436838917504:12345-0@lo:101: 00010000:00010000:1.0:1787602329.029253:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602329.029266:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ebc73fb1/0x576b7af90af465ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af465e6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602329.029298:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ebc73fb1/0x576b7af90af465ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af465e6 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602329.029308:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ebc73fb1/0x576b7af90af465ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af465e6 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602329.029317:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ebc73fb1, rc 0) 00000100:00100000:1.0:1787602329.029363:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3b04f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+10:5813:x1874436838917504:12345-0@lo:101: Request processed in 124us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602329.029370:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787602329.029524:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7150341 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838917504:0@lo:101: 00010000:00010000:3.0:1787602329.029538:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.029559:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602329.030112:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838917632:0@lo:256: 00000100:00100000:3.0:1787602329.030162:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602329.030626:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000002496c798 going to sleep for 11 seconds 00000100:00100000:1.0:1787602329.030714:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838917632 00000100:00100000:1.0:1787602329.030721:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838917632 00000100:00100000:1.0:1787602329.030768:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787602329.030775:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d5ed0c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+10:5813:x1874436838917632:12345-0@lo:256: 20000000:01000000:1.0:1787602329.030792:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787602329.030799:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787602329.031021:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d5ed0c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+10:5813:x1874436838917632:12345-0@lo:256: Request processed in 246us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602329.031028:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602329.031120:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838917632:0@lo:256: 10000000:01000000:3.0:1787602329.031770:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787602329.031797:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.031809:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602329.031816:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a487a1000 from 1 10000000:01000000:3.0:1787602329.031819:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787602329.031851:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.031858:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.031867:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602329.031884:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838917760:0@lo:101: 00000100:00100000:3.0:1787602329.031927:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602329.032108:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838917760 00000100:00100000:2.0:1787602329.032115:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838917760 00000100:00100000:2.0:1787602329.032148:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787602329.032155:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0c0d56a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+10:5813:x1874436838917760:12345-0@lo:101: 00010000:00010000:2.0:1787602329.032173:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602329.032187:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c72e1ad/0x576b7af90af465fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af465f4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.032208:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c72e1ad/0x576b7af90af465fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af465f4 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.032218:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008c72e1ad/0x576b7af90af465fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af465f4 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.032225:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008c72e1ad, rc 0) 00000100:00100000:2.0:1787602329.032256:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0c0d56a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+11:5813:x1874436838917760:12345-0@lo:101: Request processed in 102us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602329.032262:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787602329.032674:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000002496c798 going to sleep for 11 seconds 00000100:00100000:3.0:1787602329.032693:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838917760:0@lo:101: 00010000:00010000:3.0:1787602329.032706:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.032714:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602329.032764:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838917888:0@lo:501: 00000100:00100000:3.0:1787602329.032795:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602329.032815:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000002496c798 going to sleep for 11 seconds 00000100:00100000:1.0:1787602329.032870:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838917888 00000100:00100000:1.0:1787602329.032875:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838917888 00000100:00100000:1.0:1787602329.032952:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787602329.033067:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aff1bda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:5813:x1874436838917888:12345-0@lo:501: 00000100:00100000:1.0:1787602329.033996:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aff1bda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:5813:x1874436838917888:12345-0@lo:501: Request processed in 1035us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602329.034005:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787602329.034246:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838917888:0@lo:501: 00000100:00100000:3.0:1787602329.034303:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838918016:0@lo:503: 00000100:00100000:3.0:1787602329.034349:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602329.034382:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000002496c798 going to sleep for 11 seconds 00000100:00100000:2.0:1787602329.034461:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838918016 00000100:00100000:2.0:1787602329.034468:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838918016 00000100:00100000:2.0:1787602329.034503:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787602329.034511:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e220c5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:5813:x1874436838918016:12345-0@lo:503: 00000040:00080000:2.0:1787602329.034555:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787602329.034660:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e220c5d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:5813:x1874436838918016:12345-0@lo:503: Request processed in 150us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602329.034668:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602329.034733:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838918016:0@lo:503: 00000040:00080000:1.0:1787602329.035800:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787602329.036168:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787602329.036187:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787602329.036249:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.036261:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602329.036312:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787602329.036315:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff944a487a1000 10000000:01000000:3.0:1787602329.036318:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff944a487a1000 10000000:01000000:3.0:1787602329.036322:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787602329.036337:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944a487a1000 from 1 10000000:01000000:3.0:1787602329.036340:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787602329.036374:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: 0000000093631c48/0x576b7af90af46602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.036382:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: 0000000093631c48/0x576b7af90af46602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.036391:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: 0000000093631c48/0x576b7af90af46602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602329.036412:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838918144:0@lo:101: 00000100:00100000:3.0:1787602329.036481:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602329.036520:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000352f138f going to sleep for 11 seconds 00000100:00100000:1.0:1787602329.036579:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838918144 00000100:00100000:1.0:1787602329.036586:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838918144 00000100:00100000:1.0:1787602329.036625:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787602329.036633:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c7d764b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:5813:x1874436838918144:12345-0@lo:101: 00010000:00010000:1.0:1787602329.036645:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602329.036658:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002e6922d7/0x576b7af90af46609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46602 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602329.036679:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e6922d7/0x576b7af90af46609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46602 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602329.036688:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002e6922d7/0x576b7af90af46609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46602 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602329.036702:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002e6922d7, rc 0) 00000100:00100000:1.0:1787602329.036752:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c7d764b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5813:x1874436838918144:12345-0@lo:101: Request processed in 120us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602329.036759:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787602329.036845:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ec13bdd pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838918144:0@lo:101: 00010000:00010000:2.0:1787602329.036859:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: 0000000093631c48/0x576b7af90af46602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.036866:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: 0000000093631c48/0x576b7af90af46602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602329.036921:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ddd1975 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838918272:0@lo:501: 00000100:00100000:2.0:1787602329.036949:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602329.036985:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3aff07 going to sleep for 11 seconds 00000100:00100000:2.0:1787602329.037000:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838918272 00000100:00100000:2.0:1787602329.037003:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838918272 00000100:00100000:2.0:1787602329.037032:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787602329.037062:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db50eec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5813:x1874436838918272:12345-0@lo:501: 00000100:00100000:2.0:1787602329.037297:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db50eec0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5813:x1874436838918272:12345-0@lo:501: Request processed in 236us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602329.037304:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787602329.037333:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ddd1975 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838918272:0@lo:501: 00000100:00100000:2.0:1787602329.037359:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ddd1975 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838918400:0@lo:503: 00000100:00100000:2.0:1787602329.037399:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602329.037411:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee3aff07 going to sleep for 11 seconds 00000100:00100000:2.0:1787602329.037434:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838918400 00000100:00100000:2.0:1787602329.037437:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838918400 00000100:00100000:2.0:1787602329.037452:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787602329.037457:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000829d41a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5813:x1874436838918400:12345-0@lo:503: 00000100:00100000:2.0:1787602329.037733:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000829d41a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5813:x1874436838918400:12345-0@lo:503: Request processed in 276us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602329.037740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787602329.037774:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ddd1975 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838918400:0@lo:503: 00000100:00100000:0.0:1787602329.038695:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078936d53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:5861:1874436838918528:0@lo:502: 00000100:00100000:0.0:1787602329.038754:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602329.038784:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838918528 00000100:00100000:0.0:1787602329.038788:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838918528 00000100:00100000:0.0:1787602329.038815:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787602329.038821:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edb6d7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5861:x1874436838918528:12345-0@lo:502: 00000100:00100000:0.0:1787602329.039083:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edb6d7f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5861:x1874436838918528:12345-0@lo:502: Request processed in 262us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602329.039091:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787602329.039142:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 000000001356b622 going to sleep for 11 seconds 00000100:00100000:0.0:1787602329.039158:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078936d53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:5861:1874436838918528:0@lo:502: 00000020:01000004:0.0:1787602329.039414:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787602329.039441:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007a766025) 00000020:00000080:0.0:1787602329.039460:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787602329.039546:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002aede1bc from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787602329.039550:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002aede1bc from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787602329.039553:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002aede1bc 4 00010000:00080000:0.0:1787602329.039593:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002fe4a7cf@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.125@tcp at head 00010000:00010000:1.0:1787602329.043734:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787602329.044001:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787602329.044115:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787602329.044131:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x576b7af90af46617 00000100:00080000:1.0:1787602329.044142:0:5861:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787602329.044148:0:5861:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002fe4a7cf using connection 192.168.206.125@tcp/0@lo 00000100:00100000:1.0:1787602329.044371:0:5861:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001d6329a0 x1874436838918656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787602329.044442:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d6329a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874436838918656:0@lo:38: 00000100:00100000:3.0:1787602329.044516:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787602329.044577:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787602329.044759:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838918656 00000100:00100000:3.0:1787602329.044766:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838918656 00000100:00100000:3.0:1787602329.044836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602329.044843:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfbe9120 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874436838918656:12345-0@lo:38: 00000100:00100000:3.0:1787602329.044937:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfbe9120 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874436838918656:12345-0@lo:38: Request processed in 93us (421us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787602329.044944:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602329.045022:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787602329.045030:0:3310:0:(import.c:65:import_set_state_nolock()) 000000002fe4a7cf lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787602329.045034:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787602329.045101:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d6329a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874436838918656:0@lo:38: 00000100:00100000:1.0:1787602329.045536:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d6329a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:5861:1874436838918784:0@lo:502: 00000100:00100000:1.0:1787602329.045588:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602329.045623:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a003491 going to sleep for 11 seconds 00000100:00100000:0.0:1787602329.045672:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838918784 00000100:00100000:0.0:1787602329.045677:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838918784 00000100:00100000:0.0:1787602329.045716:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787602329.045723:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031a05284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5861:x1874436838918784:12345-0@lo:502: 00000100:00100000:0.0:1787602329.045947:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031a05284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5861:x1874436838918784:12345-0@lo:502: Request processed in 224us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602329.045954:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787602329.050170:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d6329a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:5861:1874436838918784:0@lo:502: 00000040:00080000:1.0:1787602329.050223:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787602329.050416:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787602329.050450:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787602329.050468:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: 0000000093631c48/0x576b7af90af46602 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.050479:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: 0000000093631c48/0x576b7af90af46602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787602329.050535:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787602329.050538:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602329.050539:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602329.050541:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602329.050542:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602329.050543:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602329.050545:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602329.050547:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602329.050548:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602329.050549:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602329.050551:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602329.050553:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787602329.050556:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787602329.050559:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787602329.050560:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602329.050562:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602329.050563:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602329.050564:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602329.050565:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602329.050566:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602329.050567:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602329.050568:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602329.050569:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602329.050570:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602329.050571:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787602329.050595:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787602329.050608:0:5813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006004f3e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838918912:0@lo:253: 00000100:00100000:3.0:1787602329.050678:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602329.050724:0:5813:0:(client.c:2715:ptlrpc_set_wait()) set 000000002496c798 going to sleep for 11 seconds 00000100:00100000:2.0:1787602329.051377:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838918912 00000100:00100000:2.0:1787602329.051387:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838918912 00000100:00100000:2.0:1787602329.051459:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787602329.051469:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005700881 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5813:x1874436838918912:12345-0@lo:253: 20000000:01000000:2.0:1787602329.051500:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787602329.051514:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1787602329.054617:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1787602329.079779:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787602329.079817:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787602329.079885:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787602329.079890:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787602329.079911:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602329.079942:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ebc73fb1/0x576b7af90af465ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af465e6 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602329.079949:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602329.079991:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ebc73fb1/0x576b7af90af465ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af465e6 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602329.080005:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ebc73fb1/0x576b7af90af465ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af465e6 expref: 12 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602329.080018:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d6329a0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874436838919040:0@lo:104: 00000100:00100000:1.0:1787602329.080114:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602329.080374:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a003491 going to sleep for 11 seconds 00000100:00100000:2.0:1787602329.082443:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838919040 00000100:00100000:2.0:1787602329.082456:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838919040 00000100:00100000:2.0:1787602329.082520:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602329.082529:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007abf6d99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+3:5849:x1874436838919040:12345-0@lo:104: 00010000:00010000:2.0:1787602329.082547:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.082650:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787602329.082655:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007abf6d99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+3:5849:x1874436838919040:12345-0@lo:104: Request processed in 128us (2542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602329.082662:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787602329.082684:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602329.082690:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.082698:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b67069a already unused, calling callback (00000000aa6cdf43) 10000000:00010000:2.0:1787602329.082701:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.082709:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602329.082715:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602329.082736:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787602329.082774:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.082781:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787602329.082803:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.082810:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: 000000003b67069a/0x576b7af90af465e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af465ed expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.082826:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602329.082828:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602329.082830:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602329.082901:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ddd1975 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838919168:0@lo:103: 00000100:00100000:2.0:1787602329.082943:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602329.082995:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838919168 00000100:00100000:2.0:1787602329.082999:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838919168 00010000:00010000:2.0:1787602329.083017:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ebc73fb1/0x576b7af90af465ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af465e6 expref: 13 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602329.083062:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602329.083068:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004525a96a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:3312:x1874436838919168:12345-0@lo:103: 00010000:00010000:2.0:1787602329.083078:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602329.083083:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ebc73fb1/0x576b7af90af465ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af465e6 expref: 13 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.083093:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ebc73fb1/0x576b7af90af465ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af465e6 expref: 13 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.083116:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.083122:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787602329.083137:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003247744s 00010000:00010000:2.0:1787602329.083142:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.083147:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.083153:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.083158:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.083163:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ca4c6de3 already unused, calling callback (00000000f2ae3209) 00010000:00010000:2.0:1787602329.083368:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.083376:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.083383:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602329.083392:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602329.083477:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004525a96a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:3312:x1874436838919168:12345-0@lo:103: Request processed in 408us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602329.083489:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787602329.083586:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ebc73fb1/0x576b7af90af465ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af465e6 expref: 12 pid: 5826 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602329.083600:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d6329a0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874436838919040:0@lo:104: 00010000:00010000:3.0:1787602329.083619:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.083632:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.083638:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602329.083643:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ca4c6de3/0x576b7af90af4661e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602329.085793:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ddd1975 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838919168:0@lo:103: 00000100:00100000:0.0:1787602329.091987:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005700881 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+11:5813:x1874436838918912:12345-0@lo:253: Request processed in 40513us (41302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602329.092003:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787602329.092158:0:5813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006004f3e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:5813:1874436838918912:0@lo:253: 10000000:01000000:3.0:1787602329.092251:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787602329.092255:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787602329.092257:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602329.092258:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602329.092260:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602329.092262:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602329.092263:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602329.092264:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602329.092266:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602329.092267:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602329.092269:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602329.092270:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602329.092272:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787602329.092352:0:5813:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787602329.097793:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602329.098949:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602329.099401:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602329.099601:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602329.099812:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602329.099983:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602329.101156:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602329.101510:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602329.101711:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602329.101885:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602329.102257:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602329.102547:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787602329.151072:0:5813:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787602329.197200:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787602329.197597:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787602329.200332:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787602329.200523:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787602329.208720:0:5866:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787602329.208730:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:2.0:1787602329.210751:0:5813:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787602329.210843:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787602329.211800:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602329.213391:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787602329.213955:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787602329.213990:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787602329.217403:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787602329.217938:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787602329.219733:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787602329.219910:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787602329.224532:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787602329.224931:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787602329.227364:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787602329.227823:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787602329.228151:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787602329.228345:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787602329.228978:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787602329.229311:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787602329.229762:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787602329.230079:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787602329.230283:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787602329.230692:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787602329.231231:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787602329.231437:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787602329.232171:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787602329.232372:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787602329.232544:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787602329.233121:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787602329.233263:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787602329.233438:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787602329.233768:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787602329.234070:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787602329.234273:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787602329.234472:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787602329.234775:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787602329.235113:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787602329.235288:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787602329.235458:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787602329.235863:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787602329.236147:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787602329.236337:0:5813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787602329.258581:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787602329.311845:0:5813:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787602329.311881:0:5813:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbadb41c93988 00100000:10000000:2.0:1787602329.311890:0:5813:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787602329.313778:0:5813:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787602329.313798:0:5813:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787602329.313812:0:5813:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787602329.313837:0:5813:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787602329.357170:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787602329.357390:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787602329.357395:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787602330.080645:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602331.107946:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602332.125865:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602333.149295:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787602333.413798:0:6109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787602334.175157:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787602334.237189:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787602334.237204:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787602334.237207:0:37:0:(import.c:65:import_set_state_nolock()) 000000002fe4a7cf lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787602334.237222:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002fe4a7cf using connection 192.168.206.125@tcp/0@lo 00000100:00100000:1.0:1787602334.237249:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003ea33abc x1874436838919424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787602334.237293:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ea33abc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874436838919424:0@lo:38: 00000100:00100000:0.0:1787602334.237755:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c92aaac6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838919296:0@lo:400: 00000100:00100000:1.0:1787602334.238234:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602334.238293:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838919424 00000100:00100000:2.0:1787602334.238304:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838919424 00000100:00100000:2.0:1787602334.238345:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602334.238352:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab23d790 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874436838919424:12345-0@lo:38: 00010000:00080000:2.0:1787602334.238400:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:2.0:1787602334.238438:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x576b7af90af46625 00000100:00100000:0.0:1787602334.238520:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:2.0:1787602334.238633:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787602334.238651:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838919296 00000100:00100000:1.0:1787602334.238656:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838919296 00000100:00100000:1.0:1787602334.238743:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787602334.238753:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fb6e0d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:3313:x1874436838919296:12345-0@lo:400: 00000100:00080000:2.0:1787602334.238782:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000395fd4c0 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602334.238839:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab23d790 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874436838919424:12345-0@lo:38: Request processed in 485us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602334.238847:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602334.238983:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fb6e0d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:3313:x1874436838919296:12345-0@lo:400: Request processed in 233us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602334.238991:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787602334.239123:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c92aaac6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838919296:0@lo:400: 00010000:00080000:0.0:1787602334.239133:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003ea33abc x1874436838919424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787602334.239149:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787602334.239163:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787602334.239168:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787602334.239171:0:3310:0:(import.c:65:import_set_state_nolock()) 000000002fe4a7cf lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787602334.239176:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ea33abc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874436838919424:0@lo:38: 00010000:00010000:0.0:1787602335.199071:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602336.225028:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602337.245707:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787602337.310086:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787602337.310094:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff944a487a1000 from 3 10000000:01000000:1.0:1787602337.310098:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787602337.310140:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: 00000000f70544e2/0x576b7af90af4662c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602337.310152:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: 00000000f70544e2/0x576b7af90af4662c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602337.310163:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: 00000000f70544e2/0x576b7af90af4662c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602337.310184:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba70d8dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838919552:0@lo:101: 00000100:00100000:1.0:1787602337.310245:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602337.310289:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000103ec882 going to sleep for 11 seconds 00000100:00100000:2.0:1787602337.310395:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838919552 00000100:00100000:2.0:1787602337.310403:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838919552 00000100:00100000:2.0:1787602337.310457:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787602337.310466:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015997b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+11:5830:x1874436838919552:12345-0@lo:101: 00010000:00010000:2.0:1787602337.310489:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602337.310502:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3b01f20/0x576b7af90af46633 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4662c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.310524:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3b01f20/0x576b7af90af46633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4662c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.310534:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3b01f20/0x576b7af90af46633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4662c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.310542:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3b01f20, rc 0) 00000100:00100000:2.0:1787602337.310583:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015997b34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5830:x1874436838919552:12345-0@lo:101: Request processed in 117us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602337.310589:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787602337.310647:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba70d8dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838919552:0@lo:101: 00010000:00010000:2.0:1787602337.310660:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: 00000000f70544e2/0x576b7af90af4662c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.310668:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: 00000000f70544e2/0x576b7af90af4662c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602337.310714:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000fb3c95d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838919680:0@lo:256: 00000100:00100000:2.0:1787602337.310745:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602337.310761:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e09842e going to sleep for 11 seconds 00000100:00100000:2.0:1787602337.310775:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838919680 00000100:00100000:2.0:1787602337.310779:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838919680 00000100:00100000:2.0:1787602337.310800:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602337.310806:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ef74be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5830:x1874436838919680:12345-0@lo:256: 20000000:01000000:2.0:1787602337.310828:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787602337.310843:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787602337.310846:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787602337.310916:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ef74be0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5830:x1874436838919680:12345-0@lo:256: Request processed in 111us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602337.310923:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602337.310953:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000fb3c95d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838919680:0@lo:256: 10000000:01000000:2.0:1787602337.311006:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787602337.311012:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: 00000000f70544e2/0x576b7af90af4662c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.311020:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: 00000000f70544e2/0x576b7af90af4662c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787602337.925546:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1ad31580 20000000:00000080:1.0:1787602337.925564:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff944a76193400 uarg=0000000000000000 20000000:01000000:1.0:1787602337.925601:0:6311:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787602337.925608:0:6311:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787602337.925613:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787602337.925904:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787602337.925916:0:6311:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787602337.934706:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602337.934989:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787602337.935205:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787602337.935327:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787602337.935347:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787602337.935366:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602337.935397:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008c72e1ad/0x576b7af90af465fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af465f4 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602337.935406:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602337.935617:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008c72e1ad/0x576b7af90af465fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af465f4 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602337.935633:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008c72e1ad/0x576b7af90af465fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af465f4 expref: 11 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602337.935648:0:6311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003363db24 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1874436838919808:0@lo:104: 00000100:00100000:1.0:1787602337.935711:0:6311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602337.935750:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838919808 00000100:00100000:0.0:1787602337.935758:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838919808 00000100:00100000:1.0:1787602337.935809:0:6311:0:(client.c:2715:ptlrpc_set_wait()) set 000000002c3c0a0b going to sleep for 11 seconds 00000100:00100000:0.0:1787602337.936862:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602337.936878:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf5a9b23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+3:6311:x1874436838919808:12345-0@lo:104: 00010000:00010000:0.0:1787602337.936895:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602337.937053:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602337.937059:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf5a9b23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+3:6311:x1874436838919808:12345-0@lo:104: Request processed in 187us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602337.937066:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787602337.937117:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602337.937124:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602337.937148:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f7cb12e already unused, calling callback (00000000aa6cdf43) 10000000:00010000:3.0:1787602337.937152:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602337.937161:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602337.937166:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602337.937171:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787602337.937216:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602337.937223:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602337.937254:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602337.937262:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: 000000006f7cb12e/0x576b7af90af465f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af465fb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602337.937268:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006004f3e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838919936:0@lo:103: 00010000:00010000:3.0:1787602337.937281:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602337.937285:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602337.937287:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602337.937310:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602337.937386:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838919936 00000100:00100000:3.0:1787602337.937394:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838919936 00010000:00010000:3.0:1787602337.937419:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008c72e1ad/0x576b7af90af465fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af465f4 expref: 12 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602337.937481:0:6311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003363db24 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1874436838919808:0@lo:104: 00010000:00010000:1.0:1787602337.937504:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602337.937606:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602337.937618:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078936d53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:3314:x1874436838919936:12345-0@lo:103: 00010000:00010000:2.0:1787602337.937631:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602337.937637:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008c72e1ad/0x576b7af90af465fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af465f4 expref: 12 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.937649:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008c72e1ad/0x576b7af90af465fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af465f4 expref: 12 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.937663:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008c72e1ad/0x576b7af90af465fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af465f4 expref: 12 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.937676:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.937694:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.937708:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.937714:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.937719:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.937725:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.937730:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000676e4f6 already unused, calling callback (00000000f2ae3209) 00010000:00010000:2.0:1787602337.937734:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.937740:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602337.937843:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602337.937851:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.938768:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.938782:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000676e4f6/0x576b7af90af4663a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602337.938802:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602337.939184:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078936d53 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:3314:x1874436838919936:12345-0@lo:103: Request processed in 1566us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602337.939203:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602337.939272:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006004f3e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838919936:0@lo:103: 00010000:00010000:0.0:1787602338.269282:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602339.293460:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602339.357496:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602339.357539:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003363db24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838920064:0@lo:400: 00000100:00100000:0.0:1787602339.357621:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602339.357685:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838920064 00000100:00100000:3.0:1787602339.357694:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838920064 00000100:00100000:3.0:1787602339.357767:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787602339.357775:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000853a06ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:3312:x1874436838920064:12345-0@lo:400: 00000100:00100000:3.0:1787602339.357851:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000853a06ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:3312:x1874436838920064:12345-0@lo:400: Request processed in 76us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602339.357858:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602339.357860:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787602339.357878:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081eac94c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838920192:0@lo:400: 00000100:00100000:1.0:1787602339.357931:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602339.358022:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003363db24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838920064:0@lo:400: 00000100:00100000:3.0:1787602339.363538:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838920192 00000100:00100000:3.0:1787602339.363553:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838920192 00000100:00100000:0.0:1787602339.363677:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602339.363694:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b210785c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838920192:12345-0@lo:400: 00000100:00100000:0.0:1787602339.365685:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b210785c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838920192:12345-0@lo:400: Request processed in 1987us (7748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602339.365700:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787602339.368948:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000081eac94c x1874436838920192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602339.368967:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081eac94c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838920192:0@lo:400: 00010000:00010000:0.0:1787602340.317494:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602341.342460:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602342.369473:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787602342.430103:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787602342.430110:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a487a1000 from 1 10000000:01000000:2.0:1787602342.430115:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787602342.430166:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: 00000000ee31f716/0x576b7af90af46641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602342.430178:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: 00000000ee31f716/0x576b7af90af46641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602342.430188:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: 00000000ee31f716/0x576b7af90af46641 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602342.430210:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000fb3c95d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838920320:0@lo:101: 00000100:00100000:2.0:1787602342.430275:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602342.430336:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000695aaf08 going to sleep for 11 seconds 00000100:00100000:0.0:1787602342.430421:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838920320 00000100:00100000:0.0:1787602342.430430:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838920320 00000100:00100000:0.0:1787602342.430490:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787602342.430501:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000371a75b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:5830:x1874436838920320:12345-0@lo:101: 00010000:00010000:0.0:1787602342.430514:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602342.430529:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000021f8384f/0x576b7af90af46648 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46641 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602342.430552:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021f8384f/0x576b7af90af46648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46641 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602342.430562:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000021f8384f/0x576b7af90af46648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46641 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602342.430571:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000021f8384f, rc 0) 00000100:00100000:0.0:1787602342.430614:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000371a75b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5830:x1874436838920320:12345-0@lo:101: Request processed in 115us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602342.430620:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787602342.430992:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000fb3c95d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838920320:0@lo:101: 00010000:00010000:3.0:1787602342.431009:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: 00000000ee31f716/0x576b7af90af46641 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602342.431020:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: 00000000ee31f716/0x576b7af90af46641 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602342.431099:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c019f158 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838920448:0@lo:501: 00000100:00100000:3.0:1787602342.431136:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602342.431170:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cf6decc going to sleep for 11 seconds 00000100:00100000:0.0:1787602342.431192:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838920448 00000100:00100000:0.0:1787602342.431198:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838920448 00000100:00100000:0.0:1787602342.431258:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787602342.431266:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c73edfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5830:x1874436838920448:12345-0@lo:501: 00000100:00100000:0.0:1787602342.431519:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c73edfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5830:x1874436838920448:12345-0@lo:501: Request processed in 253us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602342.431532:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787602342.432761:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c019f158 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838920448:0@lo:501: 00000100:00100000:3.0:1787602342.432820:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c019f158 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838920576:0@lo:503: 00000100:00100000:3.0:1787602342.432883:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602342.432943:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cf6decc going to sleep for 11 seconds 00000100:00100000:2.0:1787602342.433305:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838920576 00000100:00100000:2.0:1787602342.433312:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838920576 00000100:00100000:2.0:1787602342.433486:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787602342.433496:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9dbea1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5830:x1874436838920576:12345-0@lo:503: 00000100:00100000:2.0:1787602342.433745:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9dbea1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5830:x1874436838920576:12345-0@lo:503: Request processed in 251us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602342.433753:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787602342.433777:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c019f158 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838920576:0@lo:503: 00000100:00100000:1.0:1787602342.434840:0:6637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007bf30b61 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:6637:1874436838920704:0@lo:502: 00000100:00100000:1.0:1787602342.434903:0:6637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602342.436424:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838920704 00000100:00100000:0.0:1787602342.436436:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838920704 00000100:00100000:1.0:1787602342.436456:0:6637:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013feb748 going to sleep for 11 seconds 00000100:00100000:0.0:1787602342.436559:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787602342.436839:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003910462c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6637:x1874436838920704:12345-0@lo:502: 00000100:00100000:0.0:1787602342.437392:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003910462c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6637:x1874436838920704:12345-0@lo:502: Request processed in 472us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602342.437402:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787602342.439230:0:6637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007bf30b61 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:6637:1874436838920704:0@lo:502: 00000020:01000000:1.0:1787602342.439287:0:6637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602342.439298:0:6637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602342.439300:0:6637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787602342.439308:0:6637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944a487a1000 00000020:00000080:1.0:1787602342.439310:0:6637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787602342.439377:0:6637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:6637:1874436838920832:0@lo:502: 00000100:00100000:1.0:1787602342.439444:0:6637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602342.439486:0:6637:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4377ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602342.439540:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838920832 00000100:00100000:2.0:1787602342.439547:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838920832 00000100:00100000:2.0:1787602342.439598:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787602342.439608:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6637:x1874436838920832:12345-0@lo:502: 00000100:00100000:2.0:1787602342.439833:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6637:x1874436838920832:12345-0@lo:502: Request processed in 221us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602342.439848:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787602342.439924:0:6637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:6637:1874436838920832:0@lo:502: 00000020:01000000:1.0:1787602342.439943:0:6637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602342.439948:0:6637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602342.439950:0:6637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787602342.439953:0:6637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787602342.440151:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787602342.440171:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787602342.440181:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477800/0x576b7af90af46641 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602342.440193:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41477800/0x576b7af90af46641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602343.394833:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787602343.708013:0:6689:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787602343.708018:0:6689:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787602343.710009:0:6689:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff944a576b9000 00000020:01000004:1.0:1787602343.710118:0:6689:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787602343.710133:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787602343.710355:0:6689:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff944a7c8f19b8) 00000020:00000080:3.0:1787602343.710376:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787602343.735984:0:6689:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787602343.736373:0:6689:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787602343.768766:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787602343.785134:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787602343.785175:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787602343.785525:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787602343.785645:0:6689:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787602343.786081:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787602343.786093:0:6689:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787602343.786106:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x576b7af90af46656 00000020:01000004:1.0:1787602343.786117:0:6689:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787602343.786142:0:6689:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787602343.786145:0:6689:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787602343.786152:0:6689:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787602343.786157:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787602343.786171:0:6689:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff944a469a0000) 00000020:00000080:1.0:1787602343.786182:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787602343.793395:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602343.794878:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787602343.794888:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787602343.797661:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787602343.797682:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787602343.805817:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787602343.805833:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787602343.809694:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602343.809890:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787602343.809898:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787602343.810758:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787602343.810772:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787602343.855010:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602343.855769:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787602343.855777:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787602343.857666:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787602343.857680:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787602343.861386:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787602343.861432:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787602343.868267:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602343.868650:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787602343.868657:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787602343.873196:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787602343.873213:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787602343.926243:0:6689:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602343.927461:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787602343.927471:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787602343.932689:0:6689:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787602343.932704:0:6689:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787602343.934608:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787602343.934638:0:6689:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787602343.934644:0:6689:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787602343.969887:0:6689:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787602343.969926:0:6689:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.125@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787602343.969930:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787602343.969931:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787602343.969933:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602343.969934:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602343.969935:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602343.969936:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602343.969938:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602343.969939:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602343.969941:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602343.969942:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602343.969944:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787602343.969947:0:6689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787602343.969950:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787602343.969951:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787602343.969952:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602343.969953:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602343.969955:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602343.969956:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602343.969957:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602343.969958:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602343.969959:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602343.969960:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602343.969965:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787602343.969991:0:6689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787602343.970010:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46251f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838920960:0@lo:253: 00000100:00100000:2.0:1787602343.970117:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602343.970312:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602343.970603:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838920960 00000100:00100000:3.0:1787602343.970611:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838920960 00000100:00100000:3.0:1787602343.970673:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787602343.970684:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838920960:12345-0@lo:253: 20000000:01000000:3.0:1787602343.970714:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787602343.970718:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787602343.970723:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787602343.970726:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787602343.974146:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602343.974410:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787602343.974427:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787602343.974469:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787602343.974477:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787602343.974525:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787602343.974578:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787602343.975003:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787602343.975026:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.125@tcp 20000000:01000000:2.0:1787602343.975029:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.125@tcp (null) (null) (null) 00000040:00080000:2.0:1787602343.975115:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787602343.975125:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787602343.975174:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787602343.975183:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.125@tcp (null) (null) 00000040:00080000:2.0:1787602343.975216:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787602343.975226:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787602343.975257:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787602343.975303:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787602343.977980:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787602343.978013:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.125@tcp 20000000:01000000:3.0:1787602343.978015:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.125@tcp (null) (null) (null) 00000040:00080000:3.0:1787602343.978084:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787602343.978093:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787602343.978126:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787602343.978133:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.125@tcp (null) (null) 00000040:00080000:3.0:1787602343.978179:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787602343.978189:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787602343.978237:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787602343.978269:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787602343.978284:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787602343.978287:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787602343.978291:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787602343.978302:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787602343.978304:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787602343.978334:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787602343.978347:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787602343.983443:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787602343.983572:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787602343.983629:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787602343.984031:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787602343.984113:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787602343.984152:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787602343.984169:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787602343.984172:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787602343.987555:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787602343.987650:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787602343.987711:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787602343.988662:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787602343.988704:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787602343.988900:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787602343.988982:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787602343.988986:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787602343.989608:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787602343.989903:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787602343.989967:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787602343.990075:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787602343.990095:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787602343.990097:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787602343.990106:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787602343.990127:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.990147:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41487000/0x576b7af90af4657d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46576 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.990155:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41486400/0x576b7af90af46599 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46592 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.990162:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41487200/0x576b7af90af46609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46602 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.990169:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.990212:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41487200/0x576b7af90af46609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af46602 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.990237:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41487200/0x576b7af90af46609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af46602 expref: 12 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602343.990253:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874436838921088:0@lo:104: 00000100:00100000:3.0:1787602343.990315:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602343.990375:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838921088 00000100:00100000:2.0:1787602343.990384:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838921088 00010000:00010000:3.0:1787602343.990394:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41486400/0x576b7af90af46599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af46592 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.990404:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41486400/0x576b7af90af46599 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af46592 expref: 12 pid: 5828 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602343.990413:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874436838921216:0@lo:104: 00000100:00100000:3.0:1787602343.990441:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602343.990446:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838921216 00000100:00100000:2.0:1787602343.990451:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838921216 00010000:00010000:3.0:1787602343.990465:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41487000/0x576b7af90af4657d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af46576 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.990475:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41487000/0x576b7af90af4657d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af46576 expref: 12 pid: 5826 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602343.990484:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be23480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874436838921344:0@lo:104: 00000100:00100000:3.0:1787602343.990505:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602343.990515:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c1b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787602343.990630:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838921344 00000100:00100000:2.0:1787602343.990634:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838921344 00000100:00100000:2.0:1787602343.990661:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602343.990683:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+5:5827:x1874436838921088:12345-0@lo:104: 00010000:00010000:2.0:1787602343.990697:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a81931e00/0x576b7af90af46602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602343.990769:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787602343.990776:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+5:5827:x1874436838921088:12345-0@lo:104: Request processed in 107us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602343.990783:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602343.990803:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787602343.990810:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+4:5827:x1874436838921216:12345-0@lo:104: 00010000:00010000:1.0:1787602343.990812:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602343.990819:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a81931c00/0x576b7af90af46592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.990821:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a81931e00/0x576b7af90af46602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.990838:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a81931e00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:1.0:1787602343.990843:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a81931e00/0x576b7af90af46602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.990852:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a81931e00/0x576b7af90af46602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602343.990860:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a81931e00/0x576b7af90af46602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602343.990861:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787602343.990867:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+4:5827:x1874436838921216:12345-0@lo:104: Request processed in 59us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602343.990873:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:1.0:1787602343.990884:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787602343.990887:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602343.990896:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+3:5827:x1874436838921344:12345-0@lo:104: 00010000:00010000:2.0:1787602343.990904:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a81931200/0x576b7af90af46576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602343.990929:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787602343.990934:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+3:5827:x1874436838921344:12345-0@lo:104: Request processed in 40us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602343.990939:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787602343.990945:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a81931e00/0x576b7af90af46602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.990954:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602343.990982:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a81931e00/0x576b7af90af46602 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.990991:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a81931e00/0x576b7af90af46602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46609 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.991009:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787602343.991012:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a81931c00/0x576b7af90af46592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.991018:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a81931c00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:1.0:1787602343.991021:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a81931c00/0x576b7af90af46592 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.991028:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a81931c00/0x576b7af90af46592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602343.991062:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a81931c00/0x576b7af90af46592 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602343.991069:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787602343.991075:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874436838921088:0@lo:104: 00010000:00010000:1.0:1787602343.991085:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a81931c00/0x576b7af90af46592 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602343.991088:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874436838921216:0@lo:104: 00010000:00010000:1.0:1787602343.991098:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787602343.991102:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be23480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874436838921344:0@lo:104: 00010000:00010000:1.0:1787602343.991117:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a81931c00/0x576b7af90af46592 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.991125:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a81931c00/0x576b7af90af46592 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46599 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.991128:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.991139:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602343.991144:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a81931200/0x576b7af90af46576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.991160:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a81931200 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:1.0:1787602343.991163:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a81931200/0x576b7af90af46576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602343.991171:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a81931200/0x576b7af90af46576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602343.991178:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a81931200/0x576b7af90af46576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602343.991184:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787602343.991204:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838921600:0@lo:103: 00000100:00100000:3.0:1787602343.991233:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602343.991242:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602343.991254:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602343.991260:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838921472:0@lo:103: 00000100:00100000:3.0:1787602343.991280:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602343.991333:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838921600 00000100:00100000:3.0:1787602343.991348:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838921600 00010000:00010000:3.0:1787602343.991375:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41486400/0x576b7af90af46599 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46592 expref: 13 pid: 5828 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602343.991400:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838921472 00000100:00100000:3.0:1787602343.991403:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838921472 00010000:00010000:3.0:1787602343.991425:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41487200/0x576b7af90af46609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46602 expref: 14 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602343.991438:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602343.991444:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:3314:x1874436838921600:12345-0@lo:103: 00010000:00010000:3.0:1787602343.991465:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602343.991470:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41486400/0x576b7af90af46599 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46592 expref: 14 pid: 5828 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.991480:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41486400/0x576b7af90af46599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af46592 expref: 14 pid: 5828 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.991494:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41486400/0x576b7af90af46599 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af46592 expref: 14 pid: 5828 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.991507:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602343.991549:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:3314:x1874436838921600:12345-0@lo:103: Request processed in 105us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602343.991556:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602343.991572:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602343.991579:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:3314:x1874436838921472:12345-0@lo:103: 00010000:00010000:3.0:1787602343.991586:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602343.991591:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41487200/0x576b7af90af46609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46602 expref: 12 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.991600:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41487200/0x576b7af90af46609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af46602 expref: 12 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.991610:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41487200/0x576b7af90af46609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af46602 expref: 12 pid: 5827 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.991619:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602343.991642:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+11:3314:x1874436838921472:12345-0@lo:103: Request processed in 64us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602343.991647:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602343.991705:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838921472:0@lo:103: 00000100:00100000:1.0:1787602343.991729:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838921600:0@lo:103: 00010000:00010000:0.0:1787602343.992182:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a81931200/0x576b7af90af46576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602343.992191:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602343.992215:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a81931200/0x576b7af90af46576 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602343.992222:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a81931200/0x576b7af90af46576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4657d expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602343.992240:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602343.992241:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787602343.992242:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602343.992244:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602343.992260:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838921728:0@lo:103: 00000100:00100000:2.0:1787602343.992295:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602343.994585:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838921728 00000100:00100000:3.0:1787602343.994597:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838921728 00010000:00010000:3.0:1787602343.994643:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41487000/0x576b7af90af4657d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46576 expref: 11 pid: 5826 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602343.994801:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787602343.994811:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+11:3312:x1874436838921728:12345-0@lo:103: 00010000:00010000:3.0:1787602343.994826:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602343.994832:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41487000/0x576b7af90af4657d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46576 expref: 11 pid: 5826 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.994861:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41487000/0x576b7af90af4657d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af46576 expref: 11 pid: 5826 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.994880:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41487000/0x576b7af90af4657d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af46576 expref: 11 pid: 5826 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.995025:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.995052:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.995070:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.995078:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.995085:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.995092:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.995099:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602343.995104:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.995112:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.995139:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602343.995150:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602343.995213:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+10:3312:x1874436838921728:12345-0@lo:103: Request processed in 403us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602343.995220:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602343.995741:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838921728:0@lo:103: 00010000:00010000:0.0:1787602343.995828:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602343.995838:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602343.995844:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d71200/0x576b7af90af46664 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787602343.995858:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787602344.063071:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+9:6689:x1874436838920960:12345-0@lo:253: Request processed in 92346us (92910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602344.063089:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787602344.063452:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46251f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838920960:0@lo:253: 10000000:01000000:2.0:1787602344.063473:0:6689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787602344.063476:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787602344.063478:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787602344.063479:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602344.063481:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787602344.063482:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602344.063483:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602344.063485:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602344.063487:0:6689:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787602344.063489:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602344.063490:0:6689:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787602344.063514:0:6689:0:(tgt_mount.c:101:server_register_mount()) register mount ffff944a576b9000 from lustre-OST0000 10000000:01000000:2.0:1787602344.063544:0:6689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787602344.063547:0:6689:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787602344.063556:0:6689:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff944a4560cd28 local copy 10000000:01000000:2.0:1787602344.063560:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787602344.063605:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.063619:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.063631:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602344.063654:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46251f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838921856:0@lo:101: 00000100:00100000:2.0:1787602344.063705:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602344.063826:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4693d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787602344.063953:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838921856 00000100:00100000:0.0:1787602344.063962:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838921856 00000100:00100000:0.0:1787602344.064020:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787602344.064066:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+9:6689:x1874436838921856:12345-0@lo:101: 00010000:00010000:0.0:1787602344.064084:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602344.064100:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5890d000/0x576b7af90af46672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4666b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.064126:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890d000/0x576b7af90af46672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4666b expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.064136:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5890d000/0x576b7af90af46672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4666b expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.064226:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890d000, rc 0) 00000100:00100000:0.0:1787602344.064288:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+10:6689:x1874436838921856:12345-0@lo:101: Request processed in 254us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602344.064295:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787602344.064321:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46251f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838921856:0@lo:101: 00010000:00010000:2.0:1787602344.064357:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.064366:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602344.064501:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46251f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838921984:0@lo:501: 00000100:00100000:2.0:1787602344.064528:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602344.064558:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4693d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787602344.065536:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838921984 00000100:00100000:3.0:1787602344.065547:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838921984 00000100:00100000:3.0:1787602344.065598:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787602344.065606:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+10:6689:x1874436838921984:12345-0@lo:501: 00000100:00100000:3.0:1787602344.065917:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+10:6689:x1874436838921984:12345-0@lo:501: Request processed in 310us (1386us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602344.065925:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787602344.066247:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46251f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838921984:0@lo:501: 10000000:01000000:0.0:1787602344.066273:0:6689:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787602344.066316:0:6689:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787602344.066325:0:6689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.066347:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.066354:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.066385:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602344.066423:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602344.066430:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.066438:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477600 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:2.0:1787602344.066443:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.066452:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602344.066459:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602344.066465:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787602344.066496:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.066504:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787602344.066536:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.066551:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41477600/0x576b7af90af4666b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x576b7af90af46672 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.066570:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602344.066571:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602344.066573:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602344.066628:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602344.066647:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838922112:0@lo:103: 00000100:00100000:1.0:1787602344.066695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602344.066791:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838922112 00000100:00100000:2.0:1787602344.066798:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838922112 00000100:00100000:2.0:1787602344.066849:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602344.066858:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+10:3311:x1874436838922112:12345-0@lo:103: 00010000:00010000:2.0:1787602344.066871:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602344.066886:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890d000/0x576b7af90af46672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af4666b expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.066912:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:0.0:1787602344.066921:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff944a576b9000 10000000:01000000:0.0:1787602344.066926:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787602344.066932:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff944a4560cd28 10000000:01000000:0.0:1787602344.066935:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787602344.066939:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff944a4560cd28 from 1 10000000:01000000:0.0:1787602344.066942:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00000100:00100000:2.0:1787602344.066945:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+9:3311:x1874436838922112:12345-0@lo:103: Request processed in 88us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602344.066952:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787602344.066965:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890c000/0x576b7af90af46679 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.066974:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5890c000/0x576b7af90af46679 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.066983:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5890c000/0x576b7af90af46679 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602344.066999:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922240:0@lo:101: 00000100:00100000:1.0:1787602344.067024:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838922112:0@lo:103: 00000100:00100000:0.0:1787602344.067030:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602344.067082:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a620c6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602344.067189:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838922240 00000100:00100000:2.0:1787602344.067194:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838922240 00000100:00100000:2.0:1787602344.067229:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787602344.067236:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+9:6689:x1874436838922240:12345-0@lo:101: 00010000:00010000:2.0:1787602344.067246:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602344.067257:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41476600/0x576b7af90af46680 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46679 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.067459:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41476600/0x576b7af90af46680 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46679 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.067482:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41476600/0x576b7af90af46680 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46679 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.067489:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476600, rc 0) 00000100:00100000:2.0:1787602344.068607:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+10:6689:x1874436838922240:12345-0@lo:101: Request processed in 1311us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602344.068619:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787602344.068848:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922240:0@lo:101: 00010000:00010000:1.0:1787602344.068888:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5890c000/0x576b7af90af46679 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46680 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.068899:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5890c000/0x576b7af90af46679 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46680 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602344.068922:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787602344.068945:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890c000/0x576b7af90af46679 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46680 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.068953:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5890c000/0x576b7af90af46679 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46680 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602344.068962:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787602344.068968:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787602344.068975:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787602344.068977:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787602344.069008:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.069015:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.069023:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602344.069065:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922368:0@lo:101: 00000100:00100000:1.0:1787602344.069118:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602344.069162:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46907e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602344.069539:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838922368 00000100:00100000:2.0:1787602344.069548:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838922368 00000100:00100000:2.0:1787602344.069853:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787602344.069863:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+10:6689:x1874436838922368:12345-0@lo:101: 00010000:00010000:2.0:1787602344.069878:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602344.069894:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41477a00/0x576b7af90af4668e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46687 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.069918:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41477a00/0x576b7af90af4668e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46687 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.069929:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41477a00/0x576b7af90af4668e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46687 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.069938:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477a00, rc 0) 00000100:00100000:2.0:1787602344.069988:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+11:6689:x1874436838922368:12345-0@lo:101: Request processed in 126us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602344.069994:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787602344.070233:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922368:0@lo:101: 00010000:00010000:0.0:1787602344.070252:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.070274:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602344.070418:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922496:0@lo:501: 00000100:00100000:0.0:1787602344.070452:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602344.070620:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838922496 00000100:00100000:1.0:1787602344.070639:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838922496 00000100:00100000:1.0:1787602344.070683:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787602344.070691:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:6689:x1874436838922496:12345-0@lo:501: 00000100:00100000:0.0:1787602344.071381:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a620c6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602344.071647:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:6689:x1874436838922496:12345-0@lo:501: Request processed in 955us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602344.071656:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787602344.071754:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922496:0@lo:501: 00000100:00100000:0.0:1787602344.071811:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922624:0@lo:503: 00000100:00100000:0.0:1787602344.071854:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602344.071876:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a620c6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602344.071902:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838922624 00000100:00100000:2.0:1787602344.071910:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838922624 00000100:00100000:2.0:1787602344.071957:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787602344.071976:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:6689:x1874436838922624:12345-0@lo:503: 00000100:00100000:2.0:1787602344.072361:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:6689:x1874436838922624:12345-0@lo:503: Request processed in 387us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602344.072369:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787602344.072406:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922624:0@lo:503: 00000040:00080000:0.0:1787602344.073033:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787602344.073240:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922752:0@lo:502: 00000100:00100000:0.0:1787602344.073570:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602344.073761:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49529d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602344.073814:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838922752 00000100:00100000:1.0:1787602344.073823:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838922752 00000100:00100000:1.0:1787602344.073872:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787602344.073882:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:6689:x1874436838922752:12345-0@lo:502: 00000100:00100000:1.0:1787602344.074248:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:6689:x1874436838922752:12345-0@lo:502: Request processed in 365us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602344.074255:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787602344.074969:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922752:0@lo:502: 00000040:00080000:0.0:1787602344.076891:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787602344.076981:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787602344.077015:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787602344.077149:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787602344.077195:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787602344.077247:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787602344.077308:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922880:0@lo:502: 00000100:00100000:0.0:1787602344.077414:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602344.077602:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49529d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602344.077704:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838922880 00000100:00100000:2.0:1787602344.077714:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838922880 00000100:00100000:2.0:1787602344.077805:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787602344.077815:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:6689:x1874436838922880:12345-0@lo:502: 00000100:00100000:2.0:1787602344.078094:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:6689:x1874436838922880:12345-0@lo:502: Request processed in 280us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602344.078100:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787602344.078178:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838922880:0@lo:502: 00000040:00080000:0.0:1787602344.078296:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787602344.078309:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787602344.078980:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787602344.078990:0:6708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787602344.078996:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602344.078999:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787602344.079006:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787602344.079117:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9449451419b8) 00000020:00000080:3.0:1787602344.079144:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787602344.079154:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787602344.079215:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944a576b9000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787602344.079223:0:6708:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787602344.079231:0:6708:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x576b7af90af4669c 00010000:00010000:3.0:1787602344.083857:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787602344.084264:0:6708:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787602344.088720:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787602344.089648:0:6708:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787602344.105978:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787602344.106765:0:6708:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787602344.116033:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787602344.116072:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602344.116080:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602344.116082:0:6708:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787602344.116086:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602344.116090:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602344.116098:0:6708:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787602344.116103:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787602344.116105:0:6708:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787602344.116172:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602344.116176:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602344.116178:0:6708:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787602344.116181:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787602344.116509:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787602344.116566:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787602344.116598:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.116613:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602344.116621:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a576b9000 from 1 10000000:01000000:1.0:1787602344.116624:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787602344.116671:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.116681:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.116823:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602344.116858:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923008:0@lo:101: 00000100:00100000:1.0:1787602344.117149:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602344.117300:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602344.117796:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838923008 00000100:00100000:2.0:1787602344.117807:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838923008 00000100:00100000:2.0:1787602344.117877:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787602344.117888:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:6689:x1874436838923008:12345-0@lo:101: 00010000:00010000:2.0:1787602344.117917:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602344.117940:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41477600/0x576b7af90af466aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af466a3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.118114:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41477600/0x576b7af90af466aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af466a3 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.118126:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41477600/0x576b7af90af466aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af466a3 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602344.118136:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477600, rc 0) 00000100:00100000:2.0:1787602344.118479:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838923008:12345-0@lo:101: Request processed in 592us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602344.118490:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787602344.118881:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923008:0@lo:101: 00010000:00010000:1.0:1787602344.119025:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.119080:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602344.119653:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923136:0@lo:501: 00000100:00100000:1.0:1787602344.119727:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602344.119855:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602344.120029:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838923136 00000100:00100000:2.0:1787602344.120095:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838923136 00000100:00100000:2.0:1787602344.120184:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787602344.120195:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838923136:12345-0@lo:501: 00000100:00100000:2.0:1787602344.120583:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838923136:12345-0@lo:501: Request processed in 387us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602344.120593:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787602344.120667:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923136:0@lo:501: 00000100:00100000:1.0:1787602344.120740:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923264:0@lo:503: 00000100:00100000:1.0:1787602344.120839:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602344.126650:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838923264 00000100:00100000:2.0:1787602344.126674:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838923264 00000100:00100000:2.0:1787602344.127152:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787602344.127166:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838923264:12345-0@lo:503: 00000100:00100000:2.0:1787602344.127663:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838923264:12345-0@lo:503: Request processed in 500us (6822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602344.127673:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787602344.132952:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602344.132997:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923264:0@lo:503: 00000040:00080000:1.0:1787602344.134357:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787602344.134442:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923392:0@lo:502: 00000100:00100000:1.0:1787602344.134518:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602344.134720:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838923392 00000100:00100000:0.0:1787602344.134738:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838923392 00000100:00100000:0.0:1787602344.134810:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787602344.134823:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838923392:12345-0@lo:502: 00000100:00100000:1.0:1787602344.134951:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602344.135173:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838923392:12345-0@lo:502: Request processed in 351us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602344.135182:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787602344.139763:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923392:0@lo:502: 00000040:00080000:1.0:1787602344.140163:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787602344.140230:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787602344.140272:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923520:0@lo:502: 00000100:00100000:1.0:1787602344.140784:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602344.140843:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602344.141429:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838923520 00000100:00100000:3.0:1787602344.141440:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838923520 00000100:00100000:3.0:1787602344.141499:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787602344.141509:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838923520:12345-0@lo:502: 00000100:00100000:3.0:1787602344.141753:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838923520:12345-0@lo:502: Request processed in 244us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602344.141762:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787602344.143146:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923520:0@lo:502: 00000040:00080000:1.0:1787602344.143350:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787602344.143369:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787602344.143974:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602344.143985:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602344.143988:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787602344.143996:0:6712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944a576b9000 00000020:00000080:3.0:1787602344.143999:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787602344.144020:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602344.144023:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602344.144024:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787602344.144028:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787602344.144370:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787602344.144395:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787602344.144418:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.144431:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602344.144479:0:6689:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787602344.144483:0:6689:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff944a576b9000 10000000:01000000:1.0:1787602344.144486:0:6689:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff944a576b9000 10000000:01000000:1.0:1787602344.144491:0:6689:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787602344.144497:0:6689:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944a576b9000 from 1 10000000:01000000:1.0:1787602344.144500:0:6689:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787602344.144538:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.144547:0:6689:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.144675:0:6689:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602344.144710:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923648:0@lo:101: 00000100:00100000:1.0:1787602344.144772:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602344.144812:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787602344.144871:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838923648 00000100:00100000:0.0:1787602344.144879:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838923648 00000100:00100000:0.0:1787602344.144925:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787602344.144934:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838923648:12345-0@lo:101: 00010000:00010000:0.0:1787602344.144947:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602344.144959:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5890c200/0x576b7af90af466b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af466b1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.144981:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890c200/0x576b7af90af466b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af466b1 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.144991:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5890c200/0x576b7af90af466b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af466b1 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.144999:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890c200, rc 0) 00000100:00100000:0.0:1787602344.145067:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:6689:x1874436838923648:12345-0@lo:101: Request processed in 133us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602344.145080:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787602344.145293:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923648:0@lo:101: 00010000:00010000:3.0:1787602344.145309:0:6689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602344.145318:0:6689:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602344.145417:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923776:0@lo:501: 00000100:00100000:3.0:1787602344.145448:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602344.145468:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c1bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602344.145520:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838923776 00000100:00100000:1.0:1787602344.145526:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838923776 00000100:00100000:0.0:1787602344.145647:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787602344.145656:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:6689:x1874436838923776:12345-0@lo:501: 00000100:00100000:0.0:1787602344.145891:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:6689:x1874436838923776:12345-0@lo:501: Request processed in 235us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602344.145898:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787602344.146014:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923776:0@lo:501: 00000100:00100000:3.0:1787602344.146078:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923904:0@lo:503: 00000100:00100000:3.0:1787602344.146120:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602344.146215:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c1bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602344.146383:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838923904 00000100:00100000:1.0:1787602344.146388:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838923904 00000100:00100000:1.0:1787602344.146423:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787602344.146431:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:6689:x1874436838923904:12345-0@lo:503: 00000100:00100000:1.0:1787602344.146679:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:6689:x1874436838923904:12345-0@lo:503: Request processed in 249us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602344.146687:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787602344.146801:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838923904:0@lo:503: 00000040:00080000:3.0:1787602344.147794:0:6689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787602344.147892:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838924032:0@lo:502: 00000100:00100000:3.0:1787602344.147946:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602344.147983:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c1bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602344.148114:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838924032 00000100:00100000:1.0:1787602344.148121:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838924032 00000100:00100000:1.0:1787602344.148300:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787602344.148311:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:6689:x1874436838924032:12345-0@lo:502: 00000100:00100000:1.0:1787602344.148550:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:6689:x1874436838924032:12345-0@lo:502: Request processed in 241us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602344.148570:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787602344.148650:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838924032:0@lo:502: 00000040:00080000:3.0:1787602344.148906:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787602344.148958:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787602344.148993:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787602344.149103:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787602344.149158:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787602344.149211:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787602344.149247:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787602344.149278:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787602344.149328:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787602344.149375:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787602344.149423:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787602344.149467:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787602344.149502:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787602344.149536:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787602344.149597:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787602344.149636:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787602344.149670:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787602344.149725:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787602344.149762:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787602344.149809:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787602344.149858:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787602344.149895:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787602344.149926:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787602344.149973:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787602344.150008:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787602344.150083:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787602344.150169:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787602344.150209:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787602344.150256:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838924160:0@lo:502: 00000100:00100000:3.0:1787602344.150331:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602344.150887:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c1bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602344.150961:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838924160 00000100:00100000:0.0:1787602344.150968:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838924160 00000100:00100000:0.0:1787602344.151014:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787602344.151023:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:6689:x1874436838924160:12345-0@lo:502: 00000100:00100000:0.0:1787602344.151305:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:6689:x1874436838924160:12345-0@lo:502: Request processed in 282us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602344.151313:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787602344.151515:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838924160:0@lo:502: 00000040:00080000:3.0:1787602344.151623:0:6689:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787602344.151635:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787602344.152446:0:6713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787602344.152464:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff944a469a4d28) 00000020:00000080:1.0:1787602344.152487:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787602344.152656:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944a576b9000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787602344.152661:0:6713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff944a576b9000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787602344.152664:0:6713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944a576b9000 3 00010000:00080000:1.0:1787602344.152737:0:6713:0:(ldlm_lib.c:102:import_set_conn()) imp ffff944945802800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.125@tcp at head 00010000:00010000:0.0:1787602344.155858:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787602344.156105:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787602344.156226:0:6713:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787602344.156239:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x576b7af90af466c6 00000100:00080000:0.0:1787602344.156250:0:6713:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787602344.156257:0:6713:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff944945802800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:0.0:1787602344.156292:0:6713:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a7c2d0a80 x1874436838924288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787602344.156383:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874436838924288:0@lo:38: 00000100:00100000:2.0:1787602344.156453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787602344.159395:0:6713:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787602344.159509:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838924416:0@lo:400: 00000100:00100000:0.0:1787602344.159592:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602344.160016:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838924288 00000100:00100000:1.0:1787602344.160032:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838924288 00000100:00100000:1.0:1787602344.160089:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838924416 00000100:00100000:1.0:1787602344.160093:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838924416 00000100:00100000:1.0:1787602344.160126:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602344.160146:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838924416:12345-0@lo:400: 00000100:00100000:1.0:1787602344.160210:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838924416:12345-0@lo:400: Request processed in 76us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602344.160218:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602344.160236:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602344.160241:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1874436838924288:12345-0@lo:38: 00010000:00080000:1.0:1787602344.160263:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:1.0:1787602344.160317:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x576b7af90af466cd 00000004:00100000:1.0:1787602344.160346:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787602344.160382:0:5834:0:(import.c:65:import_set_state_nolock()) ffff944945802000 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1787602344.160848:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787602344.161105:0:6689:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787602344.161253:0:6689:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787602344.161275:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602344.161286:0:6689:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787602344.161343:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787602344.161346:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787602344.161348:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602344.161349:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602344.161350:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602344.161352:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602344.161354:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602344.161355:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602344.161357:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602344.161363:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602344.161364:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787602344.161368:0:6689:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787602344.161370:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787602344.161371:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787602344.161372:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602344.161373:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602344.161375:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602344.161376:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602344.161377:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602344.161378:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602344.161379:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602344.161379:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602344.161380:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787602344.161402:0:6689:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787602344.161417:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838924544:0@lo:253: 00000100:00100000:3.0:1787602344.161464:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602344.161490:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c1bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602344.162285:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838924544 00000100:00100000:0.0:1787602344.162302:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838924544 00000100:00100000:0.0:1787602344.162356:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787602344.162366:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:6689:x1874436838924544:12345-0@lo:253: 20000000:01000000:0.0:1787602344.162392:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787602344.162405:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787602344.163634:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874436838924288:12345-0@lo:38: Request processed in 3385us (7174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602344.163645:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787602344.163737:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff944a7c2d0700 x1874436838924416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602344.163752:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838924416:0@lo:400: 00010000:00080000:2.0:1787602344.166506:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff944a7c2d0a80 x1874436838924288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602344.166521:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787602344.166531:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787602344.166540:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787602344.166546:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787602344.166559:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944945802800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787602344.166568:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874436838924288:0@lo:38: 20000000:01000000:0.0:1787602344.199862:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787602344.199883:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787602344.199935:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787602344.199940:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787602344.199961:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.199981:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41477c00/0x576b7af90af46633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4662c expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.200012:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.200076:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41477c00/0x576b7af90af46633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af4662c expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.200089:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41477c00/0x576b7af90af46633 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af4662c expref: 13 pid: 5826 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602344.200104:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874436838924672:0@lo:104: 00000100:00100000:1.0:1787602344.200173:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602344.200226:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602344.201440:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838924672 00000100:00100000:0.0:1787602344.201451:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838924672 00000100:00100000:0.0:1787602344.201504:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602344.201515:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+3:5849:x1874436838924672:12345-0@lo:104: 00010000:00010000:0.0:1787602344.201531:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4662c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.201694:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602344.201701:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+3:5849:x1874436838924672:12345-0@lo:104: Request processed in 188us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602344.201709:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787602344.201733:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602344.201739:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4662c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.201747:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487600 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602344.201752:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4662c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.201761:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4662c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602344.201769:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4662c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602344.201787:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602344.201824:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4662c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.201831:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602344.201845:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4662c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.201852:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4662c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46633 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602344.201870:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602344.201872:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602344.201874:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602344.202003:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838924800:0@lo:103: 00000100:00100000:1.0:1787602344.202080:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602344.202152:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838924800 00000100:00100000:1.0:1787602344.202156:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838924800 00010000:00010000:1.0:1787602344.202178:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41477c00/0x576b7af90af46633 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af4662c expref: 14 pid: 5826 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602344.202278:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602344.202287:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:3314:x1874436838924800:12345-0@lo:103: 00010000:00010000:1.0:1787602344.202299:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602344.202305:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41477c00/0x576b7af90af46633 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af4662c expref: 14 pid: 5826 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.202317:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41477c00/0x576b7af90af46633 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af4662c expref: 14 pid: 5826 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.202357:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.202365:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787602344.202381:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003247744s 00010000:00010000:1.0:1787602344.202386:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.202392:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.202400:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.202407:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.202413:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41486200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602344.202417:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.202425:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.202434:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602344.202444:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602344.202476:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:3314:x1874436838924800:12345-0@lo:103: Request processed in 190us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602344.202488:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602344.202551:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838924800:0@lo:103: 00010000:00010000:3.0:1787602344.202727:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41477c00/0x576b7af90af46633 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af4662c expref: 13 pid: 5826 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602344.202739:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874436838924672:0@lo:104: 00010000:00010000:3.0:1787602344.202757:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602344.202765:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602344.202771:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602344.202778:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41486200/0x576b7af90af466d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602344.211801:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:6689:x1874436838924544:12345-0@lo:253: Request processed in 49427us (50327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602344.211830:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787602344.211936:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:6689:1874436838924544:0@lo:253: 10000000:01000000:2.0:1787602344.211953:0:6689:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787602344.211956:0:6689:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787602344.211958:0:6689:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787602344.211960:0:6689:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602344.211961:0:6689:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602344.211962:0:6689:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602344.211964:0:6689:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602344.211965:0:6689:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602344.211967:0:6689:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602344.211968:0:6689:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602344.211970:0:6689:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602344.211972:0:6689:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787602344.211988:0:6689:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787602344.217954:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602344.218444:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602344.218753:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602344.218943:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602344.219471:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602344.219819:0:6689:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787602344.221791:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1787602344.418785:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787602344.437725:0:6689:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787602344.437735:0:6689:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787602344.437770:0:6689:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787602344.437888:0:6689:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787602344.437906:0:6689:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787602344.437924:0:6689:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787602345.440477:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602346.461330:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602347.485387:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602348.510579:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602349.533273:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602349.602362:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838924928:0@lo:400: 00000100:00100000:1.0:1787602349.602434:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602349.602485:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602349.602491:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838925056:0@lo:400: 00000100:00100000:1.0:1787602349.602520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602349.602549:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838925184:0@lo:400: 00000100:00100000:1.0:1787602349.602578:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602349.602628:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838925056 00000100:00100000:1.0:1787602349.602635:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838925056 00000100:00100000:1.0:1787602349.602686:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838925184 00000100:00100000:1.0:1787602349.602690:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838925184 00000100:00100000:1.0:1787602349.602717:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602349.602724:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838925056:12345-0@lo:400: 00000100:00100000:1.0:1787602349.602775:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838925056:12345-0@lo:400: Request processed in 50us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602349.602782:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602349.602802:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602349.602809:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838925184:12345-0@lo:400: 00000100:00100000:1.0:1787602349.602839:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838925184:12345-0@lo:400: Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602349.602845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787602349.603098:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a6e6b2300 x1874436838925184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602349.603132:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838925184:0@lo:400: 00010000:00080000:1.0:1787602349.603163:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a6e6b0700 x1874436838925056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602349.603170:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838925056:0@lo:400: 00000100:00100000:2.0:1787602349.607914:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838924928 00000100:00100000:2.0:1787602349.607929:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838924928 00000100:00100000:2.0:1787602349.607983:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787602349.607993:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:3311:x1874436838924928:12345-0@lo:400: 00000100:00100000:2.0:1787602349.608105:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:3311:x1874436838924928:12345-0@lo:400: Request processed in 113us (5671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602349.608118:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787602349.608152:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602349.608745:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838924928:0@lo:400: 00010000:00010000:0.0:1787602350.561764:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787602350.797507:0:7057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787602351.581286:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602352.605645:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787602352.669165:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787602352.669173:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944a487a1000 from 21 10000000:01000000:0.0:1787602352.669178:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787602352.669228:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.669240:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.669269:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.669306:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838925312:0@lo:101: 00000100:00100000:0.0:1787602352.669376:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602352.669420:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838925312 00000100:00100000:3.0:1787602352.669428:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838925312 00000100:00100000:3.0:1787602352.669486:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787602352.669486:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.669496:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5830:x1874436838925312:12345-0@lo:101: 00010000:00010000:3.0:1787602352.669510:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602352.669632:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70000/0x576b7af90af466e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af466db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.669659:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70000/0x576b7af90af466e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af466db expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.669670:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70000/0x576b7af90af466e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af466db expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.669679:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70000, rc 0) 00000100:00100000:3.0:1787602352.669730:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838925312:12345-0@lo:101: Request processed in 234us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.669736:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787602352.669861:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838925312:0@lo:101: 00010000:00010000:0.0:1787602352.669876:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.669884:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.670397:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838925440:0@lo:501: 00000100:00100000:0.0:1787602352.670433:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.670606:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.670678:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838925440 00000100:00100000:1.0:1787602352.670684:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838925440 00000100:00100000:1.0:1787602352.670770:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787602352.670779:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838925440:12345-0@lo:501: 00000100:00100000:1.0:1787602352.671099:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838925440:12345-0@lo:501: Request processed in 320us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.671106:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787602352.671180:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838925440:0@lo:501: 00000100:00100000:0.0:1787602352.671214:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838925568:0@lo:503: 00000100:00100000:0.0:1787602352.671257:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.676027:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838925568 00000100:00100000:2.0:1787602352.676119:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838925568 00000100:00100000:2.0:1787602352.676604:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787602352.676618:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838925568:12345-0@lo:503: 00000100:00100000:0.0:1787602352.687489:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602352.693231:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838925568:0@lo:503: 00000100:00100000:2.0:1787602352.693242:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838925568:12345-0@lo:503: Request processed in 16623us (21979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602352.693341:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787602352.694225:0:7161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7161:1874436838925696:0@lo:502: 00000100:00100000:0.0:1787602352.694300:0:7161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.694339:0:7161:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.695443:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838925696 00000100:00100000:1.0:1787602352.695453:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838925696 00000100:00100000:1.0:1787602352.695506:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787602352.695516:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7161:x1874436838925696:12345-0@lo:502: 00000100:00100000:1.0:1787602352.695790:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7161:x1874436838925696:12345-0@lo:502: Request processed in 275us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.695798:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787602352.695957:0:7161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7161:1874436838925696:0@lo:502: 00000100:00100000:0.0:1787602352.696024:0:7161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7161:1874436838925824:0@lo:502: 00000100:00100000:0.0:1787602352.696109:0:7161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.696142:0:7161:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602352.696226:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838925824 00000100:00100000:2.0:1787602352.696232:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838925824 00000100:00100000:2.0:1787602352.696284:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787602352.696304:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7161:x1874436838925824:12345-0@lo:502: 00000100:00100000:2.0:1787602352.696492:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7161:x1874436838925824:12345-0@lo:502: Request processed in 190us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602352.696499:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787602352.701190:0:7161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7161:1874436838925824:0@lo:502: 00000040:00080000:0.0:1787602352.701243:0:7161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787602352.702554:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787602352.702581:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787602352.702594:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.702606:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602352.702635:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787602352.702638:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff944a487a1000 from 4 10000000:01000000:2.0:1787602352.702641:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787602352.702680:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.702688:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.702699:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602352.702721:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838925952:0@lo:101: 00000100:00100000:2.0:1787602352.702788:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.702836:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b54cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.704029:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838925952 00000100:00100000:3.0:1787602352.704178:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838925952 00000100:00100000:3.0:1787602352.704244:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787602352.704255:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838925952:12345-0@lo:101: 00010000:00010000:3.0:1787602352.704270:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602352.704298:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d71000/0x576b7af90af466f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af466e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.704342:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71000/0x576b7af90af466f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af466e9 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.704352:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d71000/0x576b7af90af466f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af466e9 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.704361:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71000, rc 0) 00000100:00100000:3.0:1787602352.705165:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838925952:12345-0@lo:101: Request processed in 908us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.705173:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787602352.708869:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838925952:0@lo:101: 00010000:00010000:0.0:1787602352.708900:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.708912:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.709404:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838926080:0@lo:256: 00000100:00100000:0.0:1787602352.709471:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.709571:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.715404:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838926080 00000100:00100000:1.0:1787602352.715420:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838926080 00000100:00100000:1.0:1787602352.715482:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787602352.715495:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838926080:12345-0@lo:256: 20000000:01000000:1.0:1787602352.715522:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787602352.715543:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787602352.715546:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787602352.715669:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838926080:12345-0@lo:256: Request processed in 177us (6198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.715678:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787602352.715780:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838926080:0@lo:256: 10000000:01000000:0.0:1787602352.715832:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787602352.715842:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.715853:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602352.715861:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787602352.715863:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787602352.715866:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787602352.715905:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.715917:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.715927:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.715944:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838926208:0@lo:101: 00000100:00100000:0.0:1787602352.715975:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.716004:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.716214:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838926208 00000100:00100000:3.0:1787602352.716219:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838926208 00000100:00100000:3.0:1787602352.716243:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787602352.716249:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838926208:12345-0@lo:101: 00010000:00010000:3.0:1787602352.716258:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602352.716271:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70400/0x576b7af90af466fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af466f7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.716303:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70400/0x576b7af90af466fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af466f7 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.716313:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70400/0x576b7af90af466fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af466f7 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.716322:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70400, rc 0) 00000100:00100000:3.0:1787602352.716351:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838926208:12345-0@lo:101: Request processed in 103us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.716357:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787602352.716438:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838926208:0@lo:101: 00010000:00010000:0.0:1787602352.716450:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.716459:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.716500:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838926336:0@lo:501: 00000100:00100000:0.0:1787602352.716523:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.716546:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602352.716616:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838926336 00000100:00100000:2.0:1787602352.716621:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838926336 00000100:00100000:2.0:1787602352.716639:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787602352.716645:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838926336:12345-0@lo:501: 00000100:00100000:2.0:1787602352.716878:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838926336:12345-0@lo:501: Request processed in 231us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602352.716893:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787602352.717016:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838926336:0@lo:501: 00000100:00100000:0.0:1787602352.717084:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838926464:0@lo:503: 00000100:00100000:0.0:1787602352.717122:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.717137:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.717252:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838926464 00000100:00100000:3.0:1787602352.717256:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838926464 00000100:00100000:3.0:1787602352.717274:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787602352.717279:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838926464:12345-0@lo:503: 00000100:00100000:3.0:1787602352.717499:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838926464:12345-0@lo:503: Request processed in 218us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.717506:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787602352.717579:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838926464:0@lo:503: 00000100:00100000:1.0:1787602352.717961:0:7162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7162:1874436838926592:0@lo:502: 00000100:00100000:1.0:1787602352.717997:0:7162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602352.718017:0:7162:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49529600 going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.718186:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838926592 00000100:00100000:3.0:1787602352.718190:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838926592 00000100:00100000:3.0:1787602352.718220:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787602352.718226:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:7162:x1874436838926592:12345-0@lo:502: 00000100:00100000:3.0:1787602352.718442:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:7162:x1874436838926592:12345-0@lo:502: Request processed in 215us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.718448:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787602352.718538:0:7162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7162:1874436838926592:0@lo:502: 00000020:01000000:0.0:1787602352.718569:0:7162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787602352.718576:0:7162:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787602352.718585:0:7162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602352.718588:0:7162:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787602352.718593:0:7162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787602352.718597:0:7162:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.125@tcp to nid 0x20000c0a8ce7d (192.168.206.125@tcp) 00000020:01000000:0.0:1787602352.718618:0:7162:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787602352.718621:0:7162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787602352.718636:0:7162:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff944a465899b8) 00000020:00000080:0.0:1787602352.718656:0:7162:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787602352.718663:0:7162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787602352.718739:0:7162:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787602352.718744:0:7162:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787602352.718750:0:7162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af4670c 00010000:00080000:0.0:1787602352.718779:0:7162:0:(ldlm_lib.c:102:import_set_conn()) imp ffff944a7c093800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.125@tcp at head 00010000:00010000:0.0:1787602352.719087:0:7162:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787602352.794391:0:7162:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787602352.794417:0:7162:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787602352.795300:0:7162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602352.795822:0:7162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602352.795876:0:7162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787602352.796720:0:7162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787602352.797731:0:7164:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787602352.797748:0:7164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787602352.798819:0:7162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787602352.798832:0:7162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787602352.798870:0:7162:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787602352.798894:0:7162:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x576b7af90af46713 00000100:00080000:0.0:1787602352.798904:0:7162:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787602352.798910:0:7162:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff944a7c093800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:0.0:1787602352.798952:0:7162:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a7c2d3800 x1874436838926720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787602352.799015:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838926720:0@lo:8: 00000100:00100000:2.0:1787602352.799130:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787602352.799411:0:7162:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787602352.799481:0:7162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602352.799486:0:7162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602352.799489:0:7162:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787602352.799492:0:7162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602352.799496:0:7162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602352.799497:0:7162:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787602352.799501:0:7162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787602352.799503:0:7162:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787602352.799529:0:7162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7162:1874436838926848:0@lo:502: 00000100:00100000:0.0:1787602352.799582:0:7162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.799599:0:7162:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b54cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.799903:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838926848 00000100:00100000:1.0:1787602352.799909:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838926848 00000100:00100000:1.0:1787602352.799947:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787602352.799956:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:7162:x1874436838926848:12345-0@lo:502: 00000100:00100000:1.0:1787602352.800255:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:7162:x1874436838926848:12345-0@lo:502: Request processed in 299us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.800264:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787602352.800321:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602352.800332:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838926976:0@lo:400: 00000100:00100000:1.0:1787602352.800363:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602352.800395:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838927104:0@lo:400: 00000100:00100000:1.0:1787602352.800418:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602352.800452:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838926976 00000100:00100000:1.0:1787602352.800456:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838926976 00000100:00100000:1.0:1787602352.800483:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838927104 00000100:00100000:1.0:1787602352.800486:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838927104 00000100:00100000:1.0:1787602352.800513:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602352.800519:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838926976:12345-0@lo:400: 00000100:00100000:1.0:1787602352.800558:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838926976:12345-0@lo:400: Request processed in 39us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.800565:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602352.800578:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602352.800593:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838927104:12345-0@lo:400: 00000100:00100000:1.0:1787602352.800628:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838927104:12345-0@lo:400: Request processed in 37us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.800633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787602352.800656:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787602352.800680:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a6e6b3b80 x1874436838927104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602352.800694:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838927104:0@lo:400: 00010000:00080000:1.0:1787602352.800722:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a6e6b2300 x1874436838926976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602352.800730:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838926976:0@lo:400: 00000100:00100000:1.0:1787602352.800769:0:7162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7162:1874436838926848:0@lo:502: 00000020:01000000:1.0:1787602352.800794:0:7162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602352.800800:0:7162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602352.800802:0:7162:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787602352.800806:0:7162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787602352.800925:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787602352.800943:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787602352.800953:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.800964:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602352.800974:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787602352.800977:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff944a4560cd28 from 1 10000000:01000000:1.0:1787602352.800980:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787602352.801013:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.801022:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.801031:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602352.801081:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838927232:0@lo:101: 00000100:00100000:1.0:1787602352.801111:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602352.801129:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b54cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.801146:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838927232 00000100:00100000:1.0:1787602352.801150:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838927232 00000100:00100000:1.0:1787602352.801173:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787602352.801181:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838927232:12345-0@lo:101: 00010000:00010000:1.0:1787602352.801189:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602352.801202:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41487200/0x576b7af90af46721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4671a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.801224:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41487200/0x576b7af90af46721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4671a expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.801234:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41487200/0x576b7af90af46721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4671a expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.801243:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487200, rc 0) 00000100:00100000:1.0:1787602352.801272:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838927232:12345-0@lo:101: Request processed in 92us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.801278:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787602352.801352:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838927232:0@lo:101: 00010000:00010000:1.0:1787602352.801365:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.801374:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602352.801414:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838927360:0@lo:501: 00000100:00100000:1.0:1787602352.801440:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602352.801452:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a42c79b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.801462:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838927360 00000100:00100000:1.0:1787602352.801466:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838927360 00000100:00100000:1.0:1787602352.801481:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787602352.801487:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838927360:12345-0@lo:501: 00000100:00100000:1.0:1787602352.801688:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838927360:12345-0@lo:501: Request processed in 200us (246us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602352.801696:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787602352.801723:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838927360:0@lo:501: 10000000:01000000:1.0:1787602352.801741:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787602352.801746:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.801753:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602352.802216:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838926720 00000100:00100000:3.0:1787602352.802223:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838926720 00000100:00100000:3.0:1787602352.802357:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602352.802363:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874436838926720:12345-0@lo:8: 00010000:00080000:3.0:1787602352.802385:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:3.0:1787602352.802417:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x576b7af90af46728 00002000:00100000:3.0:1787602352.802456:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9449410d1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787602352.802461:0:6692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787602352.802465:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787602352.802574:0:6692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787602352.802716:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787602352.803327:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9449410d1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602352.803399:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874436838926720:12345-0@lo:8: Request processed in 1034us (4268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.803417:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787602352.803525:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a7c2d3800 x1874436838926720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787602362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602352.803536:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787602352.803552:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787602352.803561:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787602352.803566:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787602352.803569:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a7c093800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787602352.803593:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787602352.803599:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838926720:0@lo:8: 00000004:00080000:2.0:1787602352.803629:0:7164:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787602352.803750:0:7164:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 183909712245ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787602352.854934:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787602352.892678:0:7165:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787602352.892710:0:7165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1874436838927616:0@lo:7: 00000100:00100000:1.0:1787602352.892797:0:7165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602352.892855:0:7165:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.892873:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838927488:0@lo:13: 00000100:00100000:1.0:1787602352.892901:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.893079:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838927488 00000100:00100000:0.0:1787602352.893099:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838927488 00000100:00100000:0.0:1787602352.893169:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602352.893179:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874436838927488:12345-0@lo:13: 00002000:00000024:0.0:1787602352.893211:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787602352.893264:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874436838927488:12345-0@lo:13: Request processed in 87us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602352.893272:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787602352.893329:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a6e6b2300 x1874436838927488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602352.893348:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838927488:0@lo:13: 00000100:00100000:3.0:1787602352.893757:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838927616 00000100:00100000:3.0:1787602352.893762:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838927616 00000100:00100000:3.0:1787602352.893797:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787602352.893806:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7165:x1874436838927616:12345-0@lo:7: 00000100:00080000:1.0:1787602352.895430:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787602352.908383:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787602352.908393:0:6694:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787602352.908640:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7165:x1874436838927616:12345-0@lo:7: Request processed in 14830us (15838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602352.908654:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787602352.908752:0:7165:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a6e6b3b80 x1874436838927616/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787602368 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602352.908769:0:7165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1874436838927616:0@lo:7: 00000004:00080000:1.0:1787602352.908783:0:7165:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787602352.908824:0:7165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1874436838927744:0@lo:5: 00000100:00100000:1.0:1787602352.908862:0:7165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602352.909027:0:7165:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.909415:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838927744 00000100:00100000:3.0:1787602352.909422:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838927744 00000100:00100000:3.0:1787602352.909595:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602352.909606:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7165:x1874436838927744:12345-0@lo:5: 00002000:00080000:3.0:1787602352.909635:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787602352.909639:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787602352.910082:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7165:x1874436838927744:12345-0@lo:5: Request processed in 477us (1217us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787602352.910099:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787602352.910705:0:7165:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a6e6b3b80 x1874436838927744/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787602368 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602352.910723:0:7165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1874436838927744:0@lo:5: 00000004:00080000:1.0:1787602352.910783:0:7165:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787602352.910821:0:7165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1874436838927872:0@lo:700: 00000100:00100000:1.0:1787602352.910861:0:7165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602352.910949:0:7165:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602352.911280:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838927872 00000100:00100000:0.0:1787602352.911300:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838927872 00000100:00100000:0.0:1787602352.911394:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602352.911411:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7165:x1874436838927872:12345-0@lo:700: 00000100:00100000:0.0:1787602352.911452:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1874436838928000:0@lo:700: 00000100:00100000:0.0:1787602352.911491:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.911595:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49ed83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602352.911677:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838928000 00000100:00100000:2.0:1787602352.911682:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838928000 00000100:00100000:2.0:1787602352.911722:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602352.911730:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1874436838928000:12345-0@lo:700: 40000000:02000000:2.0:1787602352.950496:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00010000:00080000:0.0:1787602352.959265:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a7c2d3100 x1874436838928000/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787602368 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602352.959294:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6700:1874436838928000:0@lo:700: 40000000:02000000:0.0:1787602352.959311:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787602352.961108:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6700:x1874436838928000:12345-0@lo:700: Request processed in 49370us (49607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.961135:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602353.018219:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7165:x1874436838927872:12345-0@lo:700: Request processed in 106800us (107348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602353.018234:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787602353.018407:0:7165:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a6e6b3100 x1874436838927872/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787602368 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602353.018423:0:7165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1874436838927872:0@lo:700: 00000001:00080000:1.0:1787602353.018750:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787602353.018760:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1787602353.035992:0:7165:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787602353.039768:0:7165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1874436838928128:0@lo:5: 00000100:00100000:3.0:1787602353.039846:0:7165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602353.039978:0:7165:0:(client.c:2715:ptlrpc_set_wait()) set ffff9449459ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602353.040420:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838928128 00000100:00100000:2.0:1787602353.040429:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838928128 00000100:00100000:2.0:1787602353.040525:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787602353.040536:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7165:x1874436838928128:12345-0@lo:5: 00002000:00080000:3.0:1787602353.047832:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787602353.047860:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787602353.051593:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7165:x1874436838928128:12345-0@lo:5: Request processed in 11050us (11738us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787602353.051609:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787602353.051689:0:7165:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a7be22680 x1874436838928128/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787602369 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602353.051703:0:7165:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787602353.051718:0:7165:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff944a7be22680 x1874436838928128/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787602369 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602353.051742:0:7165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7165:1874436838928128:0@lo:5: 00000004:00080000:1.0:1787602353.051756:0:7165:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787602353.633451:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602354.653651:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787602355.409853:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787602355.678208:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602356.702224:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602357.725465:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602358.302891:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838928512:0@lo:400: 00000100:00100000:1.0:1787602358.302962:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602358.303032:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602358.303059:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838928640:0@lo:400: 00000100:00100000:1.0:1787602358.303084:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602358.303132:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838928512 00000100:00100000:1.0:1787602358.303139:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838928512 00000100:00100000:1.0:1787602358.303181:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838928640 00000100:00100000:1.0:1787602358.303184:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838928640 00000100:00100000:1.0:1787602358.303209:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602358.303217:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838928512:12345-0@lo:400: 00000100:00100000:1.0:1787602358.303279:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838928512:12345-0@lo:400: Request processed in 62us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602358.303286:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602358.303302:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602358.303308:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838928640:12345-0@lo:400: 00000100:00100000:1.0:1787602358.303335:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838928640:12345-0@lo:400: Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602358.303341:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787602358.303359:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787602358.303381:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a46250700 x1874436838928640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602358.303395:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838928640:0@lo:400: 00010000:00080000:1.0:1787602358.303421:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a46250a80 x1874436838928512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602358.303430:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838928512:0@lo:400: 00000100:00100000:0.0:1787602358.304754:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838928256:0@lo:13: 00000100:00100000:0.0:1787602358.304807:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602358.304843:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838928768:0@lo:400: 00000100:00100000:0.0:1787602358.304868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602358.304891:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787602358.304898:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838928384:0@lo:400: 00000100:00100000:0.0:1787602358.304925:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602358.304966:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838928256 00000100:00100000:0.0:1787602358.304972:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838928256 00000100:00100000:0.0:1787602358.305018:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602358.305027:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838928256:12345-0@lo:13: 00002000:00000024:0.0:1787602358.305092:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602358.305664:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838928256:12345-0@lo:13: Request processed in 637us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602358.305672:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602358.305702:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838928768 00000100:00100000:0.0:1787602358.305706:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838928768 00000100:00100000:0.0:1787602358.305732:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602358.305738:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838928768:12345-0@lo:400: 00000100:00100000:0.0:1787602358.305772:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838928768:12345-0@lo:400: Request processed in 34us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602358.305778:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602358.305797:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838928384 00000100:00100000:0.0:1787602358.305801:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838928384 00000100:00100000:0.0:1787602358.305827:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787602358.305834:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+16:3313:x1874436838928384:12345-0@lo:400: 00000100:00100000:0.0:1787602358.305865:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+16:3313:x1874436838928384:12345-0@lo:400: Request processed in 31us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602358.305871:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787602358.305907:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602358.305933:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838928384:0@lo:400: 00010000:00080000:0.0:1787602358.305947:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a7be20000 x1874436838928256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602358.305957:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787602358.305976:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838928256:0@lo:13: 00010000:00080000:0.0:1787602358.305986:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a46252300 x1874436838928768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602358.306008:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838928768:0@lo:400: 00010000:00010000:2.0:1787602358.749221:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602359.782507:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602360.797304:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787602361.150292:0:7629:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787602361.150296:0:7629:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787602361.150440:0:7629:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff944945805800 00000020:01000004:1.0:1787602361.150455:0:7629:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787602361.150469:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787602361.150483:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff944a469a3370) 00000020:00000080:1.0:1787602361.150501:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787602361.172427:0:7629:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787602361.172668:0:7629:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787602361.205765:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787602361.214903:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787602361.214937:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787602361.215011:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787602361.216387:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787602361.216857:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787602361.216871:0:7629:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787602361.216884:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x576b7af90af46736 00000020:01000004:2.0:1787602361.216892:0:7629:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787602361.216915:0:7629:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787602361.216919:0:7629:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787602361.216926:0:7629:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787602361.216951:0:7629:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787602361.216956:0:7629:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787602361.235873:0:7629:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787602361.235912:0:7629:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.125@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787602361.235917:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787602361.235919:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787602361.235920:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602361.235922:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602361.235923:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602361.235924:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602361.235926:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602361.235927:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602361.235929:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602361.235931:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602361.235933:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787602361.235937:0:7629:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787602361.235939:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787602361.235941:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787602361.235942:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602361.235943:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602361.235944:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602361.235946:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602361.235947:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602361.235948:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602361.235949:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602361.235950:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602361.235952:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787602361.235978:0:7629:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787602361.235995:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838928896:0@lo:253: 00000100:00100000:3.0:1787602361.236331:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.236451:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a754286c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.236526:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838928896 00000100:00100000:1.0:1787602361.236536:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838928896 00000100:00100000:1.0:1787602361.236628:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787602361.236639:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:7629:x1874436838928896:12345-0@lo:253: 20000000:01000000:1.0:1787602361.236671:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787602361.236675:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787602361.236680:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787602361.236684:0:5828:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787602361.237879:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602361.238555:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787602361.238574:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787602361.238733:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787602361.238743:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787602361.238778:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787602361.238827:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787602361.239312:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787602361.239332:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.125@tcp 20000000:01000000:1.0:1787602361.239334:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787602361.239369:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787602361.239377:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787602361.239441:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787602361.239452:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.125@tcp (null) (null) 00000040:00080000:1.0:1787602361.239484:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787602361.239494:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787602361.239525:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787602361.239577:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787602361.240477:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787602361.240499:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.125@tcp 20000000:01000000:1.0:1787602361.240501:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.125@tcp (null) (null) (null) 00000040:00080000:1.0:1787602361.240534:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787602361.240542:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787602361.240572:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787602361.240580:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.125@tcp (null) (null) 00000040:00080000:1.0:1787602361.240606:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787602361.240682:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787602361.240731:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787602361.240765:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787602361.240779:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787602361.240782:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787602361.240788:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787602361.240789:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787602361.240792:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787602361.240804:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787602361.240806:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787602361.240838:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787602361.240841:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787602361.241689:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787602361.241759:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787602361.241814:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787602361.242403:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787602361.242448:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787602361.242483:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787602361.242496:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787602361.242498:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787602361.243381:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787602361.243443:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787602361.243499:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787602361.243808:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787602361.243860:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787602361.243916:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787602361.243929:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787602361.243932:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787602361.244734:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787602361.244996:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787602361.245336:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787602361.245411:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787602361.245425:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787602361.245427:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787602361.246550:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787602361.246783:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787602361.246821:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787602361.247391:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787602361.247439:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787602361.247580:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1787602361.247603:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787602361.247637:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.247657:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41477a00/0x576b7af90af4668e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46687 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.247665:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a5890c200/0x576b7af90af466b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af466b1 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.247672:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a47d70000/0x576b7af90af466e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af466db expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.247679:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a47d70400/0x576b7af90af466fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af466f7 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.247686:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41487200/0x576b7af90af46721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4671a expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.247693:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.248077:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41487200/0x576b7af90af46721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af4671a expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.248093:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41487200/0x576b7af90af46721 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af4671a expref: 16 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602361.248109:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874436838929024:0@lo:104: 00000100:00100000:1.0:1787602361.248177:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787602361.248228:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a47d70400/0x576b7af90af466fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af466f7 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.248235:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1787602361.248236:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a47d70400/0x576b7af90af466fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af466f7 expref: 16 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602361.248257:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874436838929152:0@lo:104: 00000100:00100000:0.0:1787602361.248263:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838929024 00000100:00100000:0.0:1787602361.248270:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838929024 00000100:00100000:1.0:1787602361.248278:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.248304:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838929152 00000100:00100000:0.0:1787602361.248306:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838929152 00000100:00100000:0.0:1787602361.248319:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787602361.248320:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a47d70000/0x576b7af90af466e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af466db expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.248327:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c36850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+4:5828:x1874436838929024:12345-0@lo:104: 00010000:00010000:1.0:1787602361.248328:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a47d70000/0x576b7af90af466e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af466db expref: 16 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602361.248337:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c485880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874436838929280:0@lo:104: 00010000:00010000:0.0:1787602361.248340:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602361.248357:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787602361.248372:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a5890c200/0x576b7af90af466b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af466b1 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.248380:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a5890c200/0x576b7af90af466b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af466b1 expref: 16 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.248383:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602361.248388:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c36850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+4:5828:x1874436838929024:12345-0@lo:104: Request processed in 62us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.248395:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602361.248398:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c485500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874436838929408:0@lo:104: 00000100:00100000:1.0:1787602361.248418:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787602361.248432:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41477a00/0x576b7af90af4668e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af46687 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.248440:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41477a00/0x576b7af90af4668e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af46687 expref: 16 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.248440:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838929280 00000100:00100000:0.0:1787602361.248443:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838929280 00000100:00100000:1.0:1787602361.248448:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c485c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874436838929536:0@lo:104: 00000100:00100000:0.0:1787602361.248454:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838929408 00000100:00100000:0.0:1787602361.248456:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838929408 00000100:00100000:0.0:1787602361.248468:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787602361.248473:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+5:5828:x1874436838929152:12345-0@lo:104: 00010000:00010000:0.0:1787602361.248481:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.248679:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602361.248686:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.248694:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41486400 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:2.0:1787602361.248697:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.248706:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602361.248713:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602361.248719:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787602361.248758:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.248764:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787602361.248798:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.248805:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af4671a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46721 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.248818:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602361.248820:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602361.248822:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602361.248835:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838929664:0@lo:103: 00010000:00010000:0.0:1787602361.249365:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602361.249375:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+5:5828:x1874436838929152:12345-0@lo:104: Request processed in 900us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.249390:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787602361.249409:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787602361.249417:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+4:5828:x1874436838929280:12345-0@lo:104: 00010000:00010000:0.0:1787602361.249426:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249523:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787602361.249529:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249537:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890de00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:3.0:1787602361.249540:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249547:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602361.249554:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602361.249559:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602361.249584:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249590:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602361.249605:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249627:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af466f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466fe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249643:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602361.249646:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249651:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890d800 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:3.0:1787602361.249654:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249660:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602361.249665:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602361.249670:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602361.249683:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249689:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602361.249694:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249700:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af466db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466e2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249708:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602361.249710:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602361.249712:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602361.249724:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838929792:0@lo:103: 00000100:00100000:3.0:1787602361.249774:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.249816:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602361.249822:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838929920:0@lo:103: 00000100:00100000:3.0:1787602361.249842:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.249873:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838929792 00000100:00100000:3.0:1787602361.249878:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838929792 00010000:00010000:3.0:1787602361.249900:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a47d70400/0x576b7af90af466fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af466f7 expref: 17 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.249922:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838929920 00000100:00100000:3.0:1787602361.249925:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838929920 00010000:00010000:3.0:1787602361.249937:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a47d70000/0x576b7af90af466e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af466db expref: 18 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.249948:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602361.249953:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:3311:x1874436838929792:12345-0@lo:103: 00010000:00010000:3.0:1787602361.249965:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602361.249970:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a47d70400/0x576b7af90af466fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af466f7 expref: 18 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249978:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a47d70400/0x576b7af90af466fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af466f7 expref: 18 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.249996:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602361.250022:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:3311:x1874436838929792:12345-0@lo:103: Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.250028:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602361.250065:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787602361.250072:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:3311:x1874436838929920:12345-0@lo:103: 00010000:00010000:3.0:1787602361.250087:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602361.250091:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a47d70000/0x576b7af90af466e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af466db expref: 17 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.250229:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a47d70000/0x576b7af90af466e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af466db expref: 17 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.250250:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602361.250274:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:3311:x1874436838929920:12345-0@lo:103: Request processed in 203us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.250280:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787602361.250325:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838929920:0@lo:103: 00000100:00100000:3.0:1787602361.250332:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838929792:0@lo:103: 00000100:00100000:1.0:1787602361.250990:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.251187:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46ab1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.251209:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874436838929024:0@lo:104: 00010000:00010000:1.0:1787602361.251221:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d70400/0x576b7af90af466fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af466f7 expref: 16 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602361.251233:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874436838929152:0@lo:104: 00010000:00010000:1.0:1787602361.251252:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d70000/0x576b7af90af466e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af466db expref: 15 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602361.251260:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c485880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874436838929280:0@lo:104: 00000100:00100000:3.0:1787602361.251327:0:5815:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787602361.251334:0:5815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787602361.251687:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838929536 00000100:00100000:3.0:1787602361.251693:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838929536 00000100:00100000:1.0:1787602361.251967:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602361.251977:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+5:5828:x1874436838929408:12345-0@lo:104: 00010000:00010000:1.0:1787602361.251990:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.252253:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602361.252266:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+5:5828:x1874436838929408:12345-0@lo:104: Request processed in 290us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.252274:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602361.252292:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787602361.252298:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+4:5828:x1874436838929536:12345-0@lo:104: 00010000:00010000:1.0:1787602361.252306:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.252343:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787602361.252348:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+4:5828:x1874436838929536:12345-0@lo:104: Request processed in 50us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.252354:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787602361.252411:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c485500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874436838929408:0@lo:104: 00000100:00100000:3.0:1787602361.252420:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c485c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874436838929536:0@lo:104: 00010000:00010000:3.0:1787602361.252453:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.252541:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787602361.252548:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.252556:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487c00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:3.0:1787602361.252560:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.252577:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602361.252584:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602361.252590:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602361.252666:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.252673:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602361.252688:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.252695:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af466b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466b8 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.252710:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602361.252713:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.252719:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487400 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:3.0:1787602361.252722:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.252728:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.252876:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787602361.252886:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+3:5828:x1874436838929280:12345-0@lo:104: Request processed in 3469us (4525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.252893:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787602361.253005:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1787602361.253553:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602361.253574:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602361.253704:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.253711:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787602361.253714:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787602361.253720:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.253727:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41487400/0x576b7af90af46687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4668e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.253746:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602361.253748:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602361.253749:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602361.253759:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838930048:0@lo:103: 00000100:00100000:2.0:1787602361.253760:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838930176:0@lo:103: 00000100:00100000:3.0:1787602361.253804:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.253838:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838929664 00000100:00100000:3.0:1787602361.253844:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838929664 00010000:00010000:3.0:1787602361.253873:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41487200/0x576b7af90af46721 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af4671a expref: 15 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.253894:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838930048 00000100:00100000:3.0:1787602361.253897:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838930048 00010000:00010000:3.0:1787602361.253909:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a5890c200/0x576b7af90af466b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af466b1 expref: 16 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602361.253920:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.253923:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602361.253930:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46253800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+16:3314:x1874436838929664:12345-0@lo:103: 00010000:00010000:3.0:1787602361.253941:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602361.253951:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41487200/0x576b7af90af46721 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af4671a expref: 16 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.253962:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41487200/0x576b7af90af46721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af4671a expref: 16 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602361.253971:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1787602361.253975:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41487200/0x576b7af90af46721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af4671a expref: 16 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602361.253978:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787602361.253990:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602361.254023:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46253800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:3314:x1874436838929664:12345-0@lo:103: Request processed in 93us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.254030:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602361.254237:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838930176 00000100:00100000:3.0:1787602361.254569:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838930176 00010000:00010000:3.0:1787602361.254589:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41477a00/0x576b7af90af4668e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46687 expref: 15 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.254606:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787602361.254660:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:3313:x1874436838930048:12345-0@lo:103: 00010000:00010000:3.0:1787602361.254670:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602361.254675:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a5890c200/0x576b7af90af466b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af466b1 expref: 15 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254685:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a5890c200/0x576b7af90af466b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af466b1 expref: 15 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254696:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890c200/0x576b7af90af466b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af466b1 expref: 15 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254707:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602361.254753:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:3313:x1874436838930048:12345-0@lo:103: Request processed in 95us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.254759:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787602361.254775:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787602361.254844:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:3314:x1874436838930176:12345-0@lo:103: 00010000:00010000:3.0:1787602361.254853:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602361.254858:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41477a00/0x576b7af90af4668e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46687 expref: 13 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254867:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41477a00/0x576b7af90af4668e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af46687 expref: 13 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254877:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41477a00/0x576b7af90af4668e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af46687 expref: 13 pid: 5826 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254889:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254897:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254911:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254919:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254926:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254932:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254943:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602361.254948:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254955:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254970:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.254981:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602361.255006:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:3314:x1874436838930176:12345-0@lo:103: Request processed in 225us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.255012:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787602361.255230:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838930048:0@lo:103: 00010000:00010000:3.0:1787602361.255274:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.255283:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.255289:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41487800/0x576b7af90af4673d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787602361.255305:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787602361.256865:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838930176:0@lo:103: 00000100:00100000:2.0:1787602361.256880:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838929664:0@lo:103: 00000100:00100000:1.0:1787602361.293690:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+11:7629:x1874436838928896:12345-0@lo:253: Request processed in 57045us (57351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.293705:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787602361.293883:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838928896:0@lo:253: 10000000:01000000:3.0:1787602361.293901:0:7629:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787602361.293904:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787602361.293919:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787602361.293921:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602361.293922:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787602361.293923:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602361.293925:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602361.293926:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602361.293928:0:7629:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787602361.293930:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602361.293931:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787602361.293971:0:7629:0:(tgt_mount.c:101:server_register_mount()) register mount ffff944945805800 from lustre-OST0001 10000000:01000000:3.0:1787602361.293999:0:7629:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787602361.294002:0:7629:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787602361.294010:0:7629:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff944a4560cd28 local copy 10000000:01000000:3.0:1787602361.294014:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787602361.294076:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.294087:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.294171:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.294191:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838930304:0@lo:101: 00000100:00100000:3.0:1787602361.294229:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.294330:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428180 going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.294473:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838930304 00000100:00100000:0.0:1787602361.294480:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838930304 00000100:00100000:0.0:1787602361.294561:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787602361.294572:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+11:7629:x1874436838930304:12345-0@lo:101: 00010000:00010000:0.0:1787602361.294585:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602361.294600:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5890d000/0x576b7af90af4674b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46744 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.294624:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890d000/0x576b7af90af4674b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46744 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.294635:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5890d000/0x576b7af90af4674b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46744 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.294645:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890d000, rc 0) 00000100:00100000:0.0:1787602361.294697:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838930304:12345-0@lo:101: Request processed in 127us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.294715:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787602361.294793:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838930304:0@lo:101: 00010000:00010000:3.0:1787602361.294807:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.294817:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.294930:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838930432:0@lo:501: 00000100:00100000:3.0:1787602361.294958:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.295461:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.295526:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838930432 00000100:00100000:1.0:1787602361.295532:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838930432 00000100:00100000:1.0:1787602361.295558:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787602361.295565:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838930432:12345-0@lo:501: 00000100:00100000:1.0:1787602361.295777:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838930432:12345-0@lo:501: Request processed in 212us (818us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602361.295878:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838930432:0@lo:501: 10000000:01000000:3.0:1787602361.295893:0:7629:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787602361.295920:0:7629:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787602361.295926:0:7629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.295935:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.295943:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.295959:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787602361.295981:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff944945805800 10000000:01000000:3.0:1787602361.295985:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787602361.295990:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787602361.295992:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787602361.295996:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787602361.295999:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787602361.296017:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.296025:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.296063:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.296076:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838930560:0@lo:101: 00000100:00100000:3.0:1787602361.296114:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.296122:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428780 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.296221:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787602361.296252:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838930560 00000100:00100000:1.0:1787602361.296256:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838930560 00000100:00100000:1.0:1787602361.296270:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787602361.296275:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838930560:12345-0@lo:101: 00010000:00010000:1.0:1787602361.296283:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602361.296300:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41486000/0x576b7af90af46759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46752 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.296319:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41486000/0x576b7af90af46759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46752 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.296328:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41486000/0x576b7af90af46759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46752 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.296335:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41486000, rc 0) 00000100:00100000:1.0:1787602361.296358:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838930560:12345-0@lo:101: Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.296363:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787602361.296430:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838930560:0@lo:101: 00010000:00010000:3.0:1787602361.296441:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.296450:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.296504:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838930688:0@lo:501: 00000100:00100000:3.0:1787602361.296525:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.296548:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428780 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.296589:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838930688 00000100:00100000:1.0:1787602361.296593:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838930688 00000100:00100000:1.0:1787602361.296607:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787602361.296611:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838930688:12345-0@lo:501: 00000100:00100000:1.0:1787602361.296859:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838930688:12345-0@lo:501: Request processed in 245us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.296866:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:0.0:1787602361.296961:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602361.296969:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.296977:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602361.296981:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.296990:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602361.296997:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602361.297003:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602361.297022:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.297029:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602361.297063:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.297071:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a47d70200/0x576b7af90af46744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x576b7af90af4674b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.297082:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602361.297084:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602361.297085:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602361.297130:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838930816:0@lo:103: 00000100:00100000:1.0:1787602361.297155:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.297227:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838930816 00000100:00100000:0.0:1787602361.297236:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838930816 00000100:00100000:0.0:1787602361.297279:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602361.297286:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:3311:x1874436838930816:12345-0@lo:103: 00010000:00010000:0.0:1787602361.297295:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602361.297307:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890d000/0x576b7af90af4674b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af46744 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.297317:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602361.297341:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:3311:x1874436838930816:12345-0@lo:103: Request processed in 56us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.297347:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602361.297459:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838930816:0@lo:103: 00000100:00100000:3.0:1787602361.297546:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838930688:0@lo:501: 00000100:00100000:3.0:1787602361.297572:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838930944:0@lo:503: 00000100:00100000:3.0:1787602361.297606:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.297656:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428780 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.297704:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838930944 00000100:00100000:2.0:1787602361.297708:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838930944 00000100:00100000:1.0:1787602361.297744:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787602361.297750:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838930944:12345-0@lo:503: 00000100:00100000:1.0:1787602361.297975:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838930944:12345-0@lo:503: Request processed in 225us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.297990:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787602361.298222:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838930944:0@lo:503: 00000040:00080000:3.0:1787602361.298499:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787602361.298566:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931072:0@lo:502: 00000100:00100000:3.0:1787602361.298606:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.298669:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428780 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.298866:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838931072 00000100:00100000:1.0:1787602361.298872:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838931072 00000100:00100000:1.0:1787602361.298893:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787602361.298899:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838931072:12345-0@lo:502: 00000100:00100000:1.0:1787602361.299230:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838931072:12345-0@lo:502: Request processed in 329us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.299237:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787602361.299354:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931072:0@lo:502: 00000040:00080000:3.0:1787602361.299621:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787602361.299672:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787602361.299704:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787602361.299748:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787602361.299866:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787602361.299907:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787602361.299937:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931200:0@lo:502: 00000100:00100000:3.0:1787602361.299980:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.300090:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428780 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.300181:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838931200 00000100:00100000:3.0:1787602361.300186:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838931200 00000100:00100000:1.0:1787602361.300299:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787602361.300309:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838931200:12345-0@lo:502: 00000100:00100000:1.0:1787602361.300511:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838931200:12345-0@lo:502: Request processed in 203us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.300518:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787602361.300708:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931200:0@lo:502: 00000040:00080000:0.0:1787602361.300888:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787602361.300900:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787602361.301694:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787602361.301702:0:7639:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787602361.301708:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602361.301710:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787602361.301715:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787602361.301732:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff944945140000) 00000020:00000080:3.0:1787602361.301753:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787602361.301758:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787602361.301900:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944945805800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787602361.301908:0:7639:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787602361.301923:0:7639:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x576b7af90af46767 00010000:00010000:3.0:1787602361.306309:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787602361.306612:0:7639:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787602361.309421:0:7639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787602361.309709:0:7639:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787602361.314075:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787602361.314873:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787602361.316276:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787602361.316289:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602361.316301:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602361.316304:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787602361.316309:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602361.316314:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602361.316315:0:7639:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787602361.316319:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787602361.316321:0:7639:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787602361.316371:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602361.316375:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602361.316377:0:7639:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787602361.316380:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787602361.316601:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787602361.316630:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787602361.316651:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.316664:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602361.316672:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944945805800 from 1 10000000:01000000:1.0:1787602361.316675:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787602361.316713:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.316721:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.316739:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602361.316763:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931328:0@lo:101: 00000100:00100000:1.0:1787602361.316932:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.316975:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.318217:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838931328 00000100:00100000:3.0:1787602361.318227:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838931328 00000100:00100000:3.0:1787602361.318282:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787602361.318293:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+12:7629:x1874436838931328:12345-0@lo:101: 00010000:00010000:3.0:1787602361.318308:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602361.318327:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d71800/0x576b7af90af46775 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4676e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.318351:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71800/0x576b7af90af46775 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4676e expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.318362:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d71800/0x576b7af90af46775 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4676e expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.318371:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71800, rc 0) 00000100:00100000:3.0:1787602361.318429:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838931328:12345-0@lo:101: Request processed in 138us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.318436:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787602361.318561:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931328:0@lo:101: 00010000:00010000:1.0:1787602361.318579:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.318588:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602361.318693:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931456:0@lo:501: 00000100:00100000:1.0:1787602361.318725:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.318751:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.318767:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838931456 00000100:00100000:1.0:1787602361.318771:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838931456 00000100:00100000:1.0:1787602361.318866:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787602361.318874:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838931456:12345-0@lo:501: 00000100:00100000:1.0:1787602361.319929:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838931456:12345-0@lo:501: Request processed in 1051us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.319940:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787602361.320079:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931456:0@lo:501: 00000100:00100000:1.0:1787602361.320283:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931584:0@lo:503: 00000100:00100000:1.0:1787602361.320331:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.320393:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.323442:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838931584 00000100:00100000:3.0:1787602361.323455:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838931584 00000100:00100000:3.0:1787602361.323520:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787602361.323529:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838931584:12345-0@lo:503: 00000100:00100000:3.0:1787602361.324236:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838931584:12345-0@lo:503: Request processed in 705us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.324256:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787602361.324329:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931584:0@lo:503: 00000040:00080000:3.0:1787602361.324602:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787602361.324678:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931712:0@lo:502: 00000100:00100000:3.0:1787602361.324723:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.324883:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.325604:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838931712 00000100:00100000:2.0:1787602361.325613:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838931712 00000100:00100000:1.0:1787602361.325716:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787602361.325725:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838931712:12345-0@lo:502: 00000100:00100000:1.0:1787602361.326062:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838931712:12345-0@lo:502: Request processed in 337us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.326070:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787602361.328455:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931712:0@lo:502: 00000040:00080000:2.0:1787602361.328776:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787602361.328915:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787602361.328957:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46252a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931840:0@lo:502: 00000100:00100000:2.0:1787602361.329028:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602361.329383:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4377c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.329523:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838931840 00000100:00100000:3.0:1787602361.329531:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838931840 00000100:00100000:3.0:1787602361.329610:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787602361.329621:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838931840:12345-0@lo:502: 00000100:00100000:3.0:1787602361.329906:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838931840:12345-0@lo:502: Request processed in 286us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.329915:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787602361.330002:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46252a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931840:0@lo:502: 00000040:00080000:2.0:1787602361.330175:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787602361.330188:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787602361.330961:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602361.330972:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602361.330975:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787602361.330982:0:7643:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944945805800 00000020:00000080:2.0:1787602361.330984:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787602361.331003:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602361.331006:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602361.331008:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787602361.331011:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787602361.331219:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787602361.331254:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602361.331272:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.331285:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602361.331331:0:7629:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787602361.331334:0:7629:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff944945805800 10000000:01000000:0.0:1787602361.331337:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff944945805800 10000000:01000000:0.0:1787602361.331340:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787602361.331346:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944945805800 from 1 10000000:01000000:0.0:1787602361.331349:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787602361.331383:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.331397:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.331409:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.331430:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931968:0@lo:101: 00000100:00100000:0.0:1787602361.331484:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.331526:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.331693:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838931968 00000100:00100000:2.0:1787602361.331700:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838931968 00000100:00100000:2.0:1787602361.331743:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787602361.331753:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838931968:12345-0@lo:101: 00010000:00010000:2.0:1787602361.331766:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602361.331780:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41477e00/0x576b7af90af46783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4677c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.331905:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41477e00/0x576b7af90af46783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4677c expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.331915:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41477e00/0x576b7af90af46783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4677c expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.331924:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477e00, rc 0) 00000100:00100000:2.0:1787602361.331968:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7629:x1874436838931968:12345-0@lo:101: Request processed in 216us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602361.331975:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787602361.332075:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838931968:0@lo:101: 00010000:00010000:0.0:1787602361.332089:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.332176:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.332282:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838932096:0@lo:501: 00000100:00100000:0.0:1787602361.332310:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.332328:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.332382:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838932096 00000100:00100000:1.0:1787602361.332387:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838932096 00000100:00100000:1.0:1787602361.332415:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787602361.332423:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7629:x1874436838932096:12345-0@lo:501: 00000100:00100000:1.0:1787602361.332647:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7629:x1874436838932096:12345-0@lo:501: Request processed in 224us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.332654:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787602361.332771:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838932096:0@lo:501: 00000100:00100000:0.0:1787602361.332874:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838932224:0@lo:503: 00000100:00100000:0.0:1787602361.332911:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.332931:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.332969:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838932224 00000100:00100000:1.0:1787602361.332973:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838932224 00000100:00100000:1.0:1787602361.333000:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787602361.333005:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7629:x1874436838932224:12345-0@lo:503: 00000100:00100000:1.0:1787602361.333316:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7629:x1874436838932224:12345-0@lo:503: Request processed in 310us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.333323:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787602361.333385:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838932224:0@lo:503: 00000040:00080000:0.0:1787602361.333668:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787602361.333754:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838932352:0@lo:502: 00000100:00100000:0.0:1787602361.333860:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.333881:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.333927:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838932352 00000100:00100000:2.0:1787602361.333936:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838932352 00000100:00100000:2.0:1787602361.333967:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787602361.333974:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7629:x1874436838932352:12345-0@lo:502: 00000100:00100000:2.0:1787602361.334251:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7629:x1874436838932352:12345-0@lo:502: Request processed in 267us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602361.334258:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787602361.334365:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838932352:0@lo:502: 00000040:00080000:0.0:1787602361.334571:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787602361.334619:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787602361.334651:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787602361.334694:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787602361.334724:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787602361.334761:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787602361.334923:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787602361.334970:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787602361.335012:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787602361.335559:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787602361.335606:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787602361.335657:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787602361.335686:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787602361.335711:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787602361.335747:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787602361.335774:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787602361.335890:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787602361.335943:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787602361.335973:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787602361.335998:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787602361.336205:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787602361.336255:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787602361.336285:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787602361.336324:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787602361.336351:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787602361.336376:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787602361.336422:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787602361.336453:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787602361.336479:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787602361.336515:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787602361.336542:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787602361.336567:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787602361.336592:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787602361.336631:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787602361.336668:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787602361.336712:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787602361.336747:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787602361.336920:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c487b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838932480:0@lo:502: 00000100:00100000:1.0:1787602361.336997:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.337354:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.337387:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838932480 00000100:00100000:2.0:1787602361.337395:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838932480 00000100:00100000:2.0:1787602361.337475:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787602361.337485:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7629:x1874436838932480:12345-0@lo:502: 00000100:00100000:2.0:1787602361.337732:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7629:x1874436838932480:12345-0@lo:502: Request processed in 248us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602361.337739:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787602361.337828:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c487b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838932480:0@lo:502: 00000040:00080000:3.0:1787602361.337916:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787602361.337929:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787602361.338676:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787602361.338695:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff944945144d28) 00000020:00000080:3.0:1787602361.338715:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787602361.338862:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944945805800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787602361.338866:0:7644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff944945805800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787602361.338868:0:7644:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944945805800 3 00010000:00080000:3.0:1787602361.338899:0:7644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff944a46291000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.125@tcp at head 00010000:00010000:2.0:1787602361.341450:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787602361.341694:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787602361.341735:0:7644:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787602361.341749:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x576b7af90af46791 00000100:00080000:2.0:1787602361.341760:0:7644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787602361.341765:0:7644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff944a46291000 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:2.0:1787602361.341879:0:7644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a46252a00 x1874436838932608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787602361.341907:0:7644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787602361.342289:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838932736:0@lo:400: 00000100:00100000:3.0:1787602361.342353:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.342398:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838932864:0@lo:400: 00000100:00100000:3.0:1787602361.342428:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.342448:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602361.342454:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838932992:0@lo:400: 00000100:00100000:3.0:1787602361.342479:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.342513:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838932736 00000100:00100000:3.0:1787602361.342520:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838932736 00000100:00100000:3.0:1787602361.342559:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838932864 00000100:00100000:3.0:1787602361.342563:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838932864 00000100:00100000:3.0:1787602361.342592:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602361.342602:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838932736:12345-0@lo:400: 00000100:00100000:3.0:1787602361.342652:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838932736:12345-0@lo:400: Request processed in 50us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.342659:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602361.342675:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787602361.342681:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838932864:12345-0@lo:400: 00000100:00100000:3.0:1787602361.342712:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838932864:12345-0@lo:400: Request processed in 32us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.342718:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787602361.342741:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838932992 00000100:00100000:3.0:1787602361.342745:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838932992 00000100:00100000:3.0:1787602361.342775:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787602361.342782:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838932992:12345-0@lo:400: 00000100:00100000:3.0:1787602361.342829:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838932992:12345-0@lo:400: Request processed in 47us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.342850:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787602361.342873:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602361.342877:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787602361.342904:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a7be20700 x1874436838932992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602361.342918:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838932992:0@lo:400: 00010000:00080000:3.0:1787602361.342930:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a7be22680 x1874436838932864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602361.342939:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838932864:0@lo:400: 00010000:00080000:3.0:1787602361.342969:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a7be20000 x1874436838932736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602361.342978:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838932736:0@lo:400: 00000040:00080000:2.0:1787602361.343263:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1787602361.343411:0:7645:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff944a46252300 x1874436838933120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602361.343421:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4377c900 going to sleep for 0 seconds 00000020:01000000:3.0:1787602361.343485:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787602361.343519:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787602361.343537:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.343547:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787602361.343611:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787602361.343613:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787602361.343615:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602361.343616:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602361.343618:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602361.343619:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602361.343621:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602361.343622:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602361.343628:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602361.343629:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602361.343631:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787602361.343635:0:7629:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787602361.343637:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787602361.343638:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787602361.343639:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602361.343640:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602361.343641:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602361.343642:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602361.343643:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602361.343644:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602361.343645:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602361.343646:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602361.343647:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787602361.343660:0:7629:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787602361.343668:0:7629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838933248:0@lo:253: 00000100:00100000:3.0:1787602361.343714:0:7629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.343748:0:7629:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.343863:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838933248 00000100:00100000:2.0:1787602361.343874:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838933248 00000100:00100000:2.0:1787602361.343915:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787602361.343922:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7629:x1874436838933248:12345-0@lo:253: 20000000:01000000:2.0:1787602361.343944:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787602361.343957:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787602361.344227:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874436838932608:0@lo:38: 00000100:00100000:0.0:1787602361.344274:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.344393:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838932608 00000100:00100000:3.0:1787602361.344397:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838932608 00000100:00100000:3.0:1787602361.344418:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602361.344423:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874436838932608:12345-0@lo:38: 00010000:00080000:3.0:1787602361.344442:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1787602361.344480:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x576b7af90af46798 00000004:00100000:3.0:1787602361.344496:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787602361.344529:0:5835:0:(import.c:65:import_set_state_nolock()) ffff944a576bc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602361.344573:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874436838932608:12345-0@lo:38: Request processed in 148us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.344580:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787602361.344619:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a46252a00 x1874436838932608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602361.344628:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787602361.344642:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787602361.344649:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787602361.344654:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787602361.344656:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a46291000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787602361.344663:0:3310:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a7168c9a): req@ffff944a46252300 x1874436838933120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602361.344679:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874436838932608:0@lo:38: 00000100:00100000:3.0:1787602361.344731:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.344760:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838933120 00000100:00100000:3.0:1787602361.344764:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838933120 00000100:00100000:3.0:1787602361.344871:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602361.344878:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1874436838933120:12345-0@lo:901: 00000100:00100000:3.0:1787602361.346025:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1874436838933120:12345-0@lo:901: Request processed in 1143us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.346035:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787602361.346127:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787602361.346155:0:7645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a46252300 x1874436838933120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787602377 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602361.346169:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46252300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1874436838933120:0@lo:901: 20000000:01000000:3.0:1787602361.371629:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787602361.371648:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787602361.372065:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787602361.372071:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787602361.372151:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.372172:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a47d71000/0x576b7af90af466f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af466e9 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.372181:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.372222:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a47d71000/0x576b7af90af466f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af466e9 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.372237:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a47d71000/0x576b7af90af466f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af466e9 expref: 14 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602361.372262:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874436838933376:0@lo:104: 00000100:00100000:2.0:1787602361.372324:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602361.372370:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4377c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.372516:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838933376 00000100:00100000:0.0:1787602361.372524:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838933376 00000100:00100000:0.0:1787602361.372575:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787602361.372585:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+3:5849:x1874436838933376:12345-0@lo:104: 00010000:00010000:0.0:1787602361.372598:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.372649:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602361.372655:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+3:5849:x1874436838933376:12345-0@lo:104: Request processed in 73us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.372674:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787602361.372712:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874436838933376:0@lo:104: 00010000:00010000:0.0:1787602361.372731:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.372787:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602361.372794:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.372801:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477200 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:3.0:1787602361.372805:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.372814:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602361.372821:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602361.372835:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602361.372870:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.372876:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602361.372892:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.372899:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af466e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.372914:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602361.372916:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602361.372918:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602361.372929:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838933504:0@lo:103: 00000100:00100000:3.0:1787602361.372964:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.373001:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838933504 00000100:00100000:3.0:1787602361.373005:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838933504 00010000:00010000:3.0:1787602361.373024:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a47d71000/0x576b7af90af466f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af466e9 expref: 15 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.373084:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602361.373091:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:3311:x1874436838933504:12345-0@lo:103: 00010000:00010000:3.0:1787602361.373493:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602361.373500:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a47d71000/0x576b7af90af466f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af466e9 expref: 15 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373512:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a47d71000/0x576b7af90af466f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af466e9 expref: 15 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373534:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d71000/0x576b7af90af466f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af466e9 expref: 15 pid: 5828 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373548:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373555:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787602361.373570:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003247744s 00010000:00010000:3.0:1787602361.373574:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373582:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373589:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373595:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373601:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477c00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602361.373606:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373613:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373629:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373649:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602361.373684:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:3311:x1874436838933504:12345-0@lo:103: Request processed in 594us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.373691:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602361.373761:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838933504:0@lo:103: 00010000:00010000:3.0:1787602361.373779:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373786:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.373793:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41477c00/0x576b7af90af4679f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.379726:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:7629:x1874436838933248:12345-0@lo:253: Request processed in 35794us (36001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.379742:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787602361.379826:0:7629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c5c99bea-fdac-431e-b440-876dfd3e206e:7629:1874436838933248:0@lo:253: 10000000:01000000:1.0:1787602361.379842:0:7629:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787602361.379845:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787602361.379847:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787602361.379848:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602361.379849:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602361.379851:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602361.379852:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602361.379865:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602361.379867:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787602361.379869:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787602361.379870:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602361.379871:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787602361.379896:0:7629:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787602361.384753:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787602361.384957:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787602361.385294:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787602361.385461:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787602361.385634:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787602361.385896:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787602361.387519:0:7629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787602361.656667:0:7629:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787602361.656674:0:7629:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787602361.656708:0:7629:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787602361.656778:0:7629:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787602361.656798:0:7629:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787602361.656823:0:7629:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 10000000:01000000:0.0:1787602361.774126:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787602361.774134:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944a576b9000 from 30 10000000:01000000:0.0:1787602361.774140:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787602361.774182:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.774194:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.774205:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.774226:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838933632:0@lo:101: 00000100:00100000:0.0:1787602361.774297:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.774346:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0540 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.774478:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838933632 00000100:00100000:1.0:1787602361.774486:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838933632 00000100:00100000:1.0:1787602361.774534:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787602361.774543:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838933632:12345-0@lo:101: 00010000:00010000:1.0:1787602361.774555:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602361.774568:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41487400/0x576b7af90af467ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af467a6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.774591:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41487400/0x576b7af90af467ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af467a6 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.774601:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41487400/0x576b7af90af467ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af467a6 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.774610:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487400, rc 0) 00000100:00100000:1.0:1787602361.774656:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838933632:12345-0@lo:101: Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.774664:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787602361.774874:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838933632:0@lo:101: 00010000:00010000:0.0:1787602361.774889:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.774925:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.774978:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838933760:0@lo:501: 00000100:00100000:0.0:1787602361.775006:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.775030:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0540 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.775200:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838933760 00000100:00100000:3.0:1787602361.775205:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838933760 00000100:00100000:3.0:1787602361.775233:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787602361.775252:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838933760:12345-0@lo:501: 00000100:00100000:3.0:1787602361.775584:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838933760:12345-0@lo:501: Request processed in 344us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.775591:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787602361.775720:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838933760:0@lo:501: 00000100:00100000:0.0:1787602361.775748:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838933888:0@lo:503: 00000100:00100000:0.0:1787602361.775784:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.775802:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0540 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.775957:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838933888 00000100:00100000:3.0:1787602361.775962:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838933888 00000100:00100000:3.0:1787602361.776003:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787602361.776010:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838933888:12345-0@lo:503: 00000100:00100000:3.0:1787602361.776643:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838933888:12345-0@lo:503: Request processed in 632us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.776652:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787602361.781219:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838933888:0@lo:503: 00000100:00100000:1.0:1787602361.784337:0:7652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7652:1874436838934016:0@lo:502: 00000100:00100000:1.0:1787602361.784419:0:7652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.784466:0:7652:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.784995:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838934016 00000100:00100000:3.0:1787602361.785004:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838934016 00000100:00100000:2.0:1787602361.785120:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787602361.785131:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7652:x1874436838934016:12345-0@lo:502: 00000100:00100000:2.0:1787602361.785486:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7652:x1874436838934016:12345-0@lo:502: Request processed in 356us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602361.785494:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787602361.785852:0:7652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7652:1874436838934016:0@lo:502: 00000100:00100000:1.0:1787602361.785918:0:7652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7652:1874436838934144:0@lo:502: 00000100:00100000:1.0:1787602361.785974:0:7652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.785999:0:7652:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.786171:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838934144 00000100:00100000:3.0:1787602361.786177:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838934144 00000100:00100000:3.0:1787602361.786217:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787602361.786226:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7652:x1874436838934144:12345-0@lo:502: 00000100:00100000:3.0:1787602361.786442:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:7652:x1874436838934144:12345-0@lo:502: Request processed in 217us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.786450:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787602361.786472:0:7652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7652:1874436838934144:0@lo:502: 00000040:00080000:1.0:1787602361.786503:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787602361.787271:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787602361.787292:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787602361.787304:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.787316:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602361.787327:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787602361.787330:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787602361.787333:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787602361.787374:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.787382:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.787391:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602361.787406:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838934272:0@lo:101: 00000100:00100000:2.0:1787602361.787446:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602361.787486:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c11600 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.787517:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838934272 00000100:00100000:1.0:1787602361.787524:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838934272 00000100:00100000:1.0:1787602361.787560:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787602361.787570:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838934272:12345-0@lo:101: 00010000:00010000:1.0:1787602361.787582:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602361.787596:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41487c00/0x576b7af90af467bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af467b4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.787618:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41487c00/0x576b7af90af467bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af467b4 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.787629:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41487c00/0x576b7af90af467bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af467b4 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.787639:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487c00, rc 0) 00000100:00100000:1.0:1787602361.787678:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838934272:12345-0@lo:101: Request processed in 110us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.787685:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787602361.787895:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838934272:0@lo:101: 00010000:00010000:2.0:1787602361.787909:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.787918:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602361.787974:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838934400:0@lo:501: 00000100:00100000:2.0:1787602361.788000:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602361.788023:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c11600 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.788207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838934400 00000100:00100000:3.0:1787602361.788213:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838934400 00000100:00100000:3.0:1787602361.788253:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787602361.788261:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838934400:12345-0@lo:501: 00000100:00100000:3.0:1787602361.788505:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838934400:12345-0@lo:501: Request processed in 244us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.788513:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787602361.788598:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838934400:0@lo:501: 00000100:00100000:0.0:1787602361.788638:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838934528:0@lo:503: 00000100:00100000:0.0:1787602361.788678:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.788706:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.788751:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838934528 00000100:00100000:2.0:1787602361.788755:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838934528 00000100:00100000:2.0:1787602361.788783:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787602361.788789:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838934528:12345-0@lo:503: 00000100:00100000:2.0:1787602361.789120:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838934528:12345-0@lo:503: Request processed in 329us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602361.789127:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787602361.789205:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838934528:0@lo:503: 00000100:00100000:0.0:1787602361.789619:0:7653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7653:1874436838934656:0@lo:502: 00000100:00100000:0.0:1787602361.789660:0:7653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.789691:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.789954:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838934656 00000100:00100000:2.0:1787602361.789959:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838934656 00000100:00100000:2.0:1787602361.789998:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787602361.790006:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:7653:x1874436838934656:12345-0@lo:502: 00000100:00100000:2.0:1787602361.790256:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:7653:x1874436838934656:12345-0@lo:502: Request processed in 250us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602361.790263:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787602361.790663:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7653:1874436838934656:0@lo:502: 00000020:01000000:0.0:1787602361.790691:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602361.790701:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602361.790703:0:7653:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787602361.790709:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787602361.790711:0:7653:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787602361.790740:0:7653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7653:1874436838934784:0@lo:502: 00000100:00100000:0.0:1787602361.790782:0:7653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.790814:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.791073:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838934784 00000100:00100000:3.0:1787602361.791079:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838934784 00000100:00100000:3.0:1787602361.791124:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787602361.791132:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+15:7653:x1874436838934784:12345-0@lo:502: 00000100:00100000:3.0:1787602361.791314:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+15:7653:x1874436838934784:12345-0@lo:502: Request processed in 182us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.791330:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787602361.791397:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7653:1874436838934784:0@lo:502: 00000020:01000000:0.0:1787602361.791416:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602361.791421:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602361.791424:0:7653:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787602361.791428:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787602361.791534:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787602361.791552:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787602361.791562:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.791575:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602361.791585:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787602361.791588:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944a487a1000 from 30 10000000:01000000:3.0:1787602361.791592:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787602361.791619:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.791627:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.791637:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.791651:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838934912:0@lo:101: 00000100:00100000:3.0:1787602361.791685:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.791715:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428780 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.791769:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838934912 00000100:00100000:2.0:1787602361.791775:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838934912 00000100:00100000:2.0:1787602361.791804:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787602361.791812:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838934912:12345-0@lo:101: 00010000:00010000:2.0:1787602361.791820:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602361.791832:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41477200/0x576b7af90af467c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af467c2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.791854:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41477200/0x576b7af90af467c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af467c2 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.791874:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41477200/0x576b7af90af467c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af467c2 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.791883:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477200, rc 0) 00000100:00100000:2.0:1787602361.792264:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838934912:12345-0@lo:101: Request processed in 452us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602361.792270:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787602361.792745:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838934912:0@lo:101: 00010000:00010000:0.0:1787602361.792761:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.792771:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.793516:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935040:0@lo:501: 00000100:00100000:0.0:1787602361.793560:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.793587:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.793878:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838935040 00000100:00100000:2.0:1787602361.793885:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838935040 00000100:00100000:2.0:1787602361.794066:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787602361.794077:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838935040:12345-0@lo:501: 00000100:00100000:2.0:1787602361.794351:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838935040:12345-0@lo:501: Request processed in 276us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602361.794359:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787602361.794424:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935040:0@lo:501: 00000100:00100000:0.0:1787602361.794452:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935168:0@lo:503: 00000100:00100000:0.0:1787602361.794491:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.799663:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838935168 00000100:00100000:3.0:1787602361.799678:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838935168 00000100:00100000:3.0:1787602361.799739:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787602361.799739:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.799748:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838935168:12345-0@lo:503: 00000100:00100000:3.0:1787602361.800080:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838935168:12345-0@lo:503: Request processed in 332us (5587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.800096:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787602361.800228:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935168:0@lo:503: 00000100:00100000:2.0:1787602361.803668:0:7655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7655:1874436838935296:0@lo:502: 00000100:00100000:2.0:1787602361.803752:0:7655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602361.803798:0:7655:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c11600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.803865:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838935296 00000100:00100000:0.0:1787602361.803874:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838935296 00000100:00100000:0.0:1787602361.803937:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787602361.803948:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+16:7655:x1874436838935296:12345-0@lo:502: 00000100:00100000:0.0:1787602361.804249:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+16:7655:x1874436838935296:12345-0@lo:502: Request processed in 291us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.804257:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787602361.804305:0:7655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7655:1874436838935296:0@lo:502: 00000100:00100000:0.0:1787602361.804347:0:7655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7655:1874436838935424:0@lo:502: 00000100:00100000:0.0:1787602361.804379:0:7655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.804395:0:7655:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787602361.804578:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838935424 00000100:00100000:2.0:1787602361.804583:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838935424 00000100:00100000:2.0:1787602361.804615:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787602361.804621:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:7655:x1874436838935424:12345-0@lo:502: 00000100:00100000:2.0:1787602361.804748:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:7655:x1874436838935424:12345-0@lo:502: Request processed in 127us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602361.804754:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787602361.804822:0:7655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7655:1874436838935424:0@lo:502: 00000040:00080000:0.0:1787602361.804840:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787602361.805060:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787602361.805078:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787602361.805199:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.805212:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602361.805222:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787602361.805224:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff944a487a1000 from 5 10000000:01000000:2.0:1787602361.805227:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787602361.805265:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.805274:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602361.805283:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602361.805296:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935552:0@lo:101: 00000100:00100000:2.0:1787602361.805327:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602361.805359:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c11600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.805397:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838935552 00000100:00100000:0.0:1787602361.805401:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838935552 00000100:00100000:0.0:1787602361.805430:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787602361.805436:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838935552:12345-0@lo:101: 00010000:00010000:0.0:1787602361.805445:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602361.805457:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5890c800/0x576b7af90af467d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af467d0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.805476:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890c800/0x576b7af90af467d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af467d0 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.805485:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5890c800/0x576b7af90af467d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af467d0 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.805494:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890c800, rc 0) 00000100:00100000:0.0:1787602361.805522:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838935552:12345-0@lo:101: Request processed in 87us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.805528:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787602361.805560:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935552:0@lo:101: 00010000:00010000:0.0:1787602361.805572:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.805581:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.805618:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935680:0@lo:256: 00000100:00100000:0.0:1787602361.805645:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.805655:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.805665:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838935680 00000100:00100000:0.0:1787602361.805668:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838935680 00000100:00100000:0.0:1787602361.805682:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787602361.805686:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838935680:12345-0@lo:256: 20000000:01000000:0.0:1787602361.805697:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787602361.805710:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787602361.805713:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787602361.805771:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838935680:12345-0@lo:256: Request processed in 83us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.805777:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787602361.805799:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935680:0@lo:256: 10000000:01000000:0.0:1787602361.805834:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787602361.805840:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.805847:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602361.805863:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787602361.805864:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787602361.805867:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787602361.805880:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.805887:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.805893:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.805904:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935808:0@lo:101: 00000100:00100000:0.0:1787602361.805942:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.805953:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e8e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.805963:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838935808 00000100:00100000:0.0:1787602361.805966:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838935808 00000100:00100000:0.0:1787602361.805979:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787602361.805984:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838935808:12345-0@lo:101: 00010000:00010000:0.0:1787602361.805990:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602361.805997:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5890dc00/0x576b7af90af467e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af467de expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.806009:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890dc00/0x576b7af90af467e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af467de expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.806018:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5890dc00/0x576b7af90af467e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af467de expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.806053:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890dc00, rc 0) 00000100:00100000:0.0:1787602361.806080:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838935808:12345-0@lo:101: Request processed in 95us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.806085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787602361.806354:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935808:0@lo:101: 00010000:00010000:0.0:1787602361.806366:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.806374:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602361.806412:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935936:0@lo:501: 00000100:00100000:0.0:1787602361.806436:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.806553:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a430396c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.813775:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838935936 00000100:00100000:3.0:1787602361.813790:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838935936 00000100:00100000:3.0:1787602361.813900:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787602361.813925:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838935936:12345-0@lo:501: 00000100:00100000:3.0:1787602361.814934:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838935936:12345-0@lo:501: Request processed in 1020us (8491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.814946:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787602361.822143:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838935936:0@lo:501: 00000100:00100000:2.0:1787602361.822214:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838936064:0@lo:503: 00000100:00100000:2.0:1787602361.822296:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602361.822328:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c11180 going to sleep for 11 seconds 00000100:00100000:3.0:1787602361.822376:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838936064 00000100:00100000:3.0:1787602361.822384:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838936064 00000100:00100000:3.0:1787602361.822438:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787602361.822448:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838936064:12345-0@lo:503: 00000100:00100000:3.0:1787602361.823863:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838936064:12345-0@lo:503: Request processed in 1409us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602361.823876:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00010000:3.0:1787602361.825155:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602361.825939:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838936064:0@lo:503: 00000100:00100000:2.0:1787602361.829145:0:7658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46251180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7658:1874436838936192:0@lo:502: 00000100:00100000:2.0:1787602361.829222:0:7658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602361.829276:0:7658:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c11600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.829330:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838936192 00000100:00100000:0.0:1787602361.829337:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838936192 00000100:00100000:0.0:1787602361.829384:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787602361.829393:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:7658:x1874436838936192:12345-0@lo:502: 00000100:00100000:0.0:1787602361.829712:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:7658:x1874436838936192:12345-0@lo:502: Request processed in 320us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.829720:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787602361.829754:0:7658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46251180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7658:1874436838936192:0@lo:502: 00000020:01000000:3.0:1787602361.829783:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787602361.829791:0:7658:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787602361.829799:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602361.829802:0:7658:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787602361.829808:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787602361.829812:0:7658:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.125@tcp to nid 0x20000c0a8ce7d (192.168.206.125@tcp) 00000020:01000000:3.0:1787602361.829834:0:7658:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787602361.829837:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787602361.829853:0:7658:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff944945143370) 00000020:00000080:3.0:1787602361.829875:0:7658:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787602361.829887:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787602361.829965:0:7658:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787602361.829971:0:7658:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787602361.829979:0:7658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af467f3 00010000:00080000:3.0:1787602361.830007:0:7658:0:(ldlm_lib.c:102:import_set_conn()) imp ffff944a468a3000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.125@tcp at head 00010000:00010000:2.0:1787602361.830428:0:7658:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787602361.830725:0:7658:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787602361.830736:0:7658:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787602361.832383:0:7658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602361.832614:0:7658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602361.832666:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787602361.832724:0:7658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787602361.834162:0:7659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602361.834169:0:7659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787602361.838705:0:7658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787602361.838721:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787602361.838754:0:7658:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787602361.838782:0:7658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x576b7af90af467fa 00000100:00080000:0.0:1787602361.838793:0:7658:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787602361.838874:0:7658:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff944a468a3000 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:0.0:1787602361.838910:0:7658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a7c2d1180 x1874436838936320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602361.838943:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838936320:0@lo:8: 00000100:00100000:0.0:1787602361.839010:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.839090:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838936320 00000100:00100000:0.0:1787602361.839097:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838936320 00000100:00100000:0.0:1787602361.839127:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787602361.839135:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1874436838936320:12345-0@lo:8: 00010000:00080000:0.0:1787602361.839160:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1787602361.839186:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x576b7af90af46801 00002000:00100000:0.0:1787602361.839200:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff944a7c86c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787602361.839205:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787602361.839209:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787602361.839335:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787602361.839493:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787602361.839515:0:6693:0:(import.c:65:import_set_state_nolock()) ffff944a7c868800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787602361.839615:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874436838936320:12345-0@lo:8: Request processed in 478us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.839622:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787602361.839641:0:7658:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787602361.839703:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602361.839707:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602361.839709:0:7658:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787602361.839712:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602361.839722:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602361.839723:0:7658:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787602361.839727:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787602361.839729:0:7658:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787602361.839752:0:7658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7658:1874436838936448:0@lo:502: 00000100:00100000:0.0:1787602361.839792:0:7658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.840116:0:7658:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47962e40 going to sleep for 11 seconds 00010000:00080000:3.0:1787602361.841533:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c2d1180 x1874436838936320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787602371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602361.841548:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787602361.841558:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787602361.841567:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787602361.841573:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787602361.841577:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a468a3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787602361.841633:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787602361.841640:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838936320:0@lo:8: 00000004:00080000:3.0:1787602361.841672:0:7659:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787602361.841823:0:7659:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 192947785465ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787602361.842213:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838936448 00000100:00100000:1.0:1787602361.842221:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838936448 00000100:00100000:1.0:1787602361.842279:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787602361.842289:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:7658:x1874436838936448:12345-0@lo:502: 00000100:00100000:1.0:1787602361.842548:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:7658:x1874436838936448:12345-0@lo:502: Request processed in 260us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.842556:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787602361.843090:0:7658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:7658:1874436838936448:0@lo:502: 00000020:01000000:3.0:1787602361.843125:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602361.843133:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602361.843135:0:7658:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787602361.843140:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1787602361.849227:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787602361.849271:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787602361.849282:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.849295:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602361.849307:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787602361.849310:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff944a4560cd28 from 1 10000000:01000000:1.0:1787602361.849313:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787602361.849350:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.849358:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.849369:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602361.849392:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838936576:0@lo:101: 00000100:00100000:1.0:1787602361.849461:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.849501:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.849530:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838936576 00000100:00100000:1.0:1787602361.849538:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838936576 00000100:00100000:1.0:1787602361.849583:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787602361.849593:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838936576:12345-0@lo:101: 00010000:00010000:1.0:1787602361.849606:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602361.849619:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41486200/0x576b7af90af4680f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46808 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.849645:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41486200/0x576b7af90af4680f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46808 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.849656:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41486200/0x576b7af90af4680f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46808 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.849666:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41486200, rc 0) 00000100:00100000:1.0:1787602361.849702:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838936576:12345-0@lo:101: Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602361.849708:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787602361.849755:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838936576:0@lo:101: 00010000:00010000:1.0:1787602361.849781:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.849791:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602361.849974:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838936704:0@lo:501: 00000100:00100000:1.0:1787602361.850001:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.850018:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.850033:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838936704 00000100:00100000:1.0:1787602361.850057:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838936704 00000100:00100000:1.0:1787602361.850079:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787602361.850085:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838936704:12345-0@lo:501: 00000100:00100000:1.0:1787602361.850296:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838936704:12345-0@lo:501: Request processed in 210us (293us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602361.850303:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787602361.850331:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838936704:0@lo:501: 10000000:01000000:1.0:1787602361.850353:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787602361.850359:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602361.850366:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787602361.900632:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787602361.960191:0:7660:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787602361.960226:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7660:1874436838936960:0@lo:7: 00000100:00100000:0.0:1787602361.960302:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.960347:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49529b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.960379:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838936832:0@lo:13: 00000100:00100000:0.0:1787602361.960406:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602361.960442:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838936960 00000100:00100000:0.0:1787602361.960450:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838936960 00000100:00100000:0.0:1787602361.960501:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602361.960510:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7660:x1874436838936960:12345-0@lo:7: 00000100:00080000:2.0:1787602361.962128:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602361.962155:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838936832 00000100:00100000:2.0:1787602361.962164:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838936832 00000100:00100000:2.0:1787602361.962219:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602361.962229:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874436838936832:12345-0@lo:13: 00002000:00000024:2.0:1787602361.962264:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1787602361.962335:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874436838936832:12345-0@lo:13: Request processed in 107us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602361.962342:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00080000:0.0:1787602361.967392:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787602361.967400:0:6692:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787602361.967494:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7660:x1874436838936960:12345-0@lo:7: Request processed in 6980us (7187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.967504:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787602361.967571:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c2d0000 x1874436838936832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602361.967596:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838936832:0@lo:13: 00010000:00080000:2.0:1787602361.967786:0:7660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c2d3800 x1874436838936960/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787602377 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602361.967797:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7660:1874436838936960:0@lo:7: 00000004:00080000:2.0:1787602361.967815:0:7660:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787602361.967850:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46251f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7660:1874436838937088:0@lo:5: 00000100:00100000:2.0:1787602361.967896:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602361.967946:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.968254:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838937088 00000100:00100000:0.0:1787602361.968262:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838937088 00000100:00100000:0.0:1787602361.968435:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602361.968447:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7660:x1874436838937088:12345-0@lo:5: 00002000:00080000:0.0:1787602361.968473:0:6693:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787602361.968477:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787602361.968736:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7660:x1874436838937088:12345-0@lo:5: Request processed in 292us (839us total) trans 4294967297 rc 0/0 00010000:00080000:1.0:1787602361.968789:0:7660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a46251f80 x1874436838937088/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787602377 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602361.968801:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46251f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7660:1874436838937088:0@lo:5: 00000004:00080000:1.0:1787602361.968812:0:7660:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787602361.968839:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7660:1874436838937216:0@lo:700: 00000100:00100000:1.0:1787602361.968876:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.968897:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.970104:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838937216 00000100:00100000:1.0:1787602361.970114:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838937216 00000100:00100000:1.0:1787602361.970161:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602361.970170:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:7660:x1874436838937216:12345-0@lo:700: 00000100:00100000:1.0:1787602361.970214:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1874436838937344:0@lo:700: 00000100:00100000:1.0:1787602361.970281:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602361.970303:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602361.970323:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838937344 00000100:00100000:1.0:1787602361.970327:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838937344 00000100:00100000:1.0:1787602361.970352:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602361.970357:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1874436838937344:12345-0@lo:700: 00000100:00100000:0.0:1787602361.972020:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 40000000:02000000:1.0:1787602362.010567:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787602362.015505:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6700:x1874436838937344:12345-0@lo:700: Request processed in 45137us (45214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602362.015525:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787602362.015605:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c484700 x1874436838937344/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787602377 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602362.015622:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6700:1874436838937344:0@lo:700: 40000000:02000000:1.0:1787602362.015633:0:6700:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1787602362.062222:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787602362.062251:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787602362.062453:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7660:x1874436838937216:12345-0@lo:700: Request processed in 92279us (93581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602362.062470:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787602362.062667:0:7660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c484380 x1874436838937216/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787602377 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602362.062678:0:7660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787602362.062694:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7660:1874436838937216:0@lo:700: 00000004:02000040:1.0:1787602362.100930:0:7660:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787602362.109924:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7660:1874436838937472:0@lo:5: 00000100:00100000:1.0:1787602362.110005:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602362.110435:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a495290c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602362.112496:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838937472 00000100:00100000:2.0:1787602362.112509:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838937472 00000100:00100000:2.0:1787602362.112659:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787602362.112671:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7660:x1874436838937472:12345-0@lo:5: 00002000:00080000:2.0:1787602362.126898:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787602362.126925:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787602362.135841:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7660:x1874436838937472:12345-0@lo:5: Request processed in 23160us (25825us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787602362.135860:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787602362.135908:0:7660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c484700 x1874436838937472/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787602378 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602362.135931:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7660:1874436838937472:0@lo:5: 00000004:00080000:1.0:1787602362.135953:0:7660:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787602362.845373:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602363.421413:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838937600:0@lo:13: 00000100:00100000:3.0:1787602363.421493:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602363.421599:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838937600 00000100:00100000:3.0:1787602363.421607:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838937600 00000100:00100000:3.0:1787602363.421689:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602363.421699:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838937600:12345-0@lo:13: 00002000:00000024:3.0:1787602363.421737:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602363.421779:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838937600:12345-0@lo:13: Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602363.421786:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787602363.421832:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be22300 x1874436838937600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602363.421851:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838937600:0@lo:13: 00000100:00080000:0.0:1787602363.421929:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787602363.870324:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602364.893483:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602365.918408:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602366.942544:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602367.005728:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838937728:0@lo:400: 00000100:00100000:3.0:1787602367.005842:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602367.005916:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838938240:0@lo:400: 00000100:00100000:3.0:1787602367.005947:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602367.005977:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602367.005983:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838938112:0@lo:400: 00000100:00100000:3.0:1787602367.006010:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602367.006062:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838937856:0@lo:400: 00000100:00100000:3.0:1787602367.006468:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602367.006494:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838938368:0@lo:400: 00000100:00100000:3.0:1787602367.006520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602367.006542:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602367.006548:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838937984:0@lo:400: 00000100:00100000:3.0:1787602367.006571:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602367.006609:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838937728 00000100:00100000:3.0:1787602367.006624:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838937728 00000100:00100000:3.0:1787602367.006681:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787602367.006691:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838937728:12345-0@lo:400: 00000100:00100000:3.0:1787602367.006753:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838937728:12345-0@lo:400: Request processed in 63us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602367.006761:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787602367.006800:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838938240 00000100:00100000:3.0:1787602367.007502:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838938240 00000100:00100000:3.0:1787602367.007558:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838937856 00000100:00100000:3.0:1787602367.007562:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838937856 00000100:00100000:3.0:1787602367.007580:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838937984 00000100:00100000:3.0:1787602367.007583:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838937984 00000100:00100000:3.0:1787602367.007603:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787602367.007611:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838938240:12345-0@lo:400: 00000100:00100000:3.0:1787602367.007678:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838938240:12345-0@lo:400: Request processed in 68us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602367.007684:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787602367.007700:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602367.007706:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838937856:12345-0@lo:400: 00000100:00100000:3.0:1787602367.007743:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838937856:12345-0@lo:400: Request processed in 36us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602367.007749:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602367.007759:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787602367.007765:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838937984:12345-0@lo:400: 00000100:00100000:3.0:1787602367.007794:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838937984:12345-0@lo:400: Request processed in 29us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602367.007799:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787602367.008187:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838938112 00000100:00100000:3.0:1787602367.008192:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838938112 00000100:00100000:3.0:1787602367.008239:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838938368 00000100:00100000:3.0:1787602367.008242:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838938368 00000100:00100000:3.0:1787602367.008261:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602367.008268:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838938112:12345-0@lo:400: 00000100:00100000:3.0:1787602367.008309:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838938112:12345-0@lo:400: Request processed in 42us (2298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602367.008315:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602367.008328:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602367.008334:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874436838938368:12345-0@lo:400: 00000100:00100000:3.0:1787602367.008362:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874436838938368:12345-0@lo:400: Request processed in 28us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602367.008368:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787602367.008436:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be20380 x1874436838937984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602367.008454:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838937984:0@lo:400: 00010000:00080000:3.0:1787602367.008466:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be23100 x1874436838937856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602367.008475:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838937856:0@lo:400: 00010000:00080000:3.0:1787602367.008483:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be21180 x1874436838938368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602367.008491:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838938368:0@lo:400: 00010000:00080000:3.0:1787602367.008533:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be20e00 x1874436838938112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602367.008554:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838938112:0@lo:400: 00000100:00100000:3.0:1787602367.008567:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838937728:0@lo:400: 00010000:00080000:3.0:1787602367.008576:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be22d80 x1874436838938240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602367.008583:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838938240:0@lo:400: 00000100:00080000:0.0:1787602367.008712:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602367.008717:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602367.008720:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602367.008997:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602367.009014:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838938496:0@lo:13: 00000100:00100000:0.0:1787602367.009119:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602367.009413:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838938496 00000100:00100000:1.0:1787602367.009420:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838938496 00000100:00100000:1.0:1787602367.009469:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602367.009478:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874436838938496:12345-0@lo:13: 00002000:00000024:1.0:1787602367.009515:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602367.009569:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874436838938496:12345-0@lo:13: Request processed in 92us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602367.009583:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787602367.009621:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c487800 x1874436838938496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602367.009639:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838938496:0@lo:13: 00000001:00080000:3.0:1787602367.664414:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787602367.966191:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787602368.424734:0:7996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787602368.541515:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787602368.541550:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838938624:0@lo:13: 00000100:00100000:2.0:1787602368.543646:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602368.543719:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838938624 00000100:00100000:1.0:1787602368.543731:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838938624 00000100:00100000:1.0:1787602368.543799:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602368.543810:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838938624:12345-0@lo:13: 00002000:00000024:1.0:1787602368.543854:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602368.543920:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838938624:12345-0@lo:13: Request processed in 112us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602368.543928:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787602368.543962:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be22d80 x1874436838938624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602368.543985:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838938624:0@lo:13: 00010000:00010000:3.0:1787602368.989302:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602370.013215:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602371.037400:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602372.062394:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602372.126935:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838938752:0@lo:13: 00000100:00100000:2.0:1787602372.127008:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602372.127211:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838939136:0@lo:400: 00000100:00100000:1.0:1787602372.127256:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602372.127305:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838939008:0@lo:400: 00000100:00100000:3.0:1787602372.127338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602372.127360:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787602372.127365:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838938880:0@lo:400: 00000100:00100000:3.0:1787602372.127394:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602372.127416:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838939392:0@lo:400: 00000100:00100000:3.0:1787602372.127453:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602372.127460:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838939264:0@lo:400: 00000100:00100000:3.0:1787602372.127483:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838939136 00000100:00100000:2.0:1787602372.127488:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602372.127491:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838939136 00000100:00100000:2.0:1787602372.127516:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838939264 00000100:00100000:2.0:1787602372.127520:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838939264 00000100:00100000:3.0:1787602372.127533:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838939008 00000100:00100000:3.0:1787602372.127536:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838939008 00000100:00100000:3.0:1787602372.127546:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838939392 00000100:00100000:3.0:1787602372.127548:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838939392 00000100:00100000:2.0:1787602372.127550:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602372.127558:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838939264:12345-0@lo:400: 00000100:00100000:3.0:1787602372.127567:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787602372.127571:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838939136:12345-0@lo:400: 00000100:00100000:3.0:1787602372.127602:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838939136:12345-0@lo:400: Request processed in 30us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602372.127603:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838939264:12345-0@lo:400: Request processed in 46us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602372.127609:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787602372.127609:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787602372.127625:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602372.127631:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838939008:12345-0@lo:400: 00010000:00080000:2.0:1787602372.127646:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be21180 x1874436838939264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602372.127661:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838939008:12345-0@lo:400: Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602372.127661:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838939264:0@lo:400: 00000100:00100000:3.0:1787602372.127667:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602372.127677:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787602372.127683:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838939392:12345-0@lo:400: 00000100:00100000:3.0:1787602372.127709:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838939392:12345-0@lo:400: Request processed in 26us (256us total) trans 0 rc 0/0 00010000:00080000:1.0:1787602372.127713:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be20e00 x1874436838939136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602372.127714:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787602372.127723:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838939136:0@lo:400: 00000100:00100000:1.0:1787602372.127744:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838938880 00000100:00100000:1.0:1787602372.127747:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838938880 00000100:00100000:1.0:1787602372.127783:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787602372.127789:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838938880:12345-0@lo:400: 00000100:00100000:1.0:1787602372.127821:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838938880:12345-0@lo:400: Request processed in 32us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602372.127826:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787602372.127892:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838938880:0@lo:400: 00010000:00080000:3.0:1787602372.127902:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be23100 x1874436838939392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602372.127910:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838939392:0@lo:400: 00010000:00080000:3.0:1787602372.127919:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7be22300 x1874436838939008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602372.127926:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838939008:0@lo:400: 00000100:00100000:0.0:1787602372.128127:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838938752 00000100:00100000:0.0:1787602372.128132:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838938752 00000100:00100000:0.0:1787602372.128164:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602372.128171:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838938752:12345-0@lo:13: 00002000:00000024:0.0:1787602372.128209:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602372.128259:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838938752:12345-0@lo:13: Request processed in 89us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602372.128265:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787602372.128409:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c2d0e00 x1874436838938752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602372.128418:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787602372.128433:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838938752:0@lo:13: 00000100:00080000:0.0:1787602372.128683:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602372.128687:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602372.128691:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602373.089225:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602373.598300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602373.598732:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821090432 00000100:00100000:3.0:1787602373.598745:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821090432 00000100:00100000:3.0:1787602373.598802:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 111 00000100:00100000:3.0:1787602373.598831:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1874436821090432:12345-192.168.206.25@tcp:250: 00010000:00080000:3.0:1787602373.598869:0:5828:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 79237443-cd99-4e6f-9597-f72f9f4e4ed2@192.168.206.25@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:3.0:1787602373.598904:0:5828:0:(genops.c:1385:class_connect()) connect: client 79237443-cd99-4e6f-9597-f72f9f4e4ed2, cookie 0x576b7af90af46816 00000100:00080000:3.0:1787602373.599292:0:5828:0:(import.c:65:import_set_state_nolock()) ffff944a7554e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602373.599374:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+5:2360:x1874436821090432:12345-192.168.206.25@tcp:250: Request processed in 543us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602373.599383:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 111 00000100:00100000:2.0:1787602373.610636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602373.610709:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821090560 00000100:00100000:1.0:1787602373.610730:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821090560 00000100:00100000:1.0:1787602373.610793:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 112 00000100:00100000:1.0:1787602373.610804:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+5:5586:x1874436821090560:12345-192.168.206.25@tcp:101: 00010000:00010000:1.0:1787602373.610824:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602373.610844:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41487a00/0x576b7af90af4681d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fc1b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602373.610875:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41487a00/0x576b7af90af4681d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc1b expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602373.610887:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41487a00/0x576b7af90af4681d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc1b expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602373.610898:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487a00, rc 0) 00000100:00100000:1.0:1787602373.610957:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+6:5586:x1874436821090560:12345-192.168.206.25@tcp:101: Request processed in 155us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602373.610964:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 112 00000100:00100000:2.0:1787602373.614736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602373.614815:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821090688 00000100:00100000:3.0:1787602373.614828:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821090688 00000100:00100000:3.0:1787602373.614891:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 113 00000100:00100000:3.0:1787602373.614902:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+6:5586:x1874436821090688:12345-192.168.206.25@tcp:501: 00000100:00100000:3.0:1787602373.615687:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+6:5586:x1874436821090688:12345-192.168.206.25@tcp:501: Request processed in 782us (959us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602373.615698:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 113 00000100:00100000:2.0:1787602373.623807:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602373.623891:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821090816 00000100:00100000:3.0:1787602373.623904:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821090816 00000100:00100000:3.0:1787602373.623967:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 114 00000100:00100000:3.0:1787602373.623979:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+6:5586:x1874436821090816:12345-192.168.206.25@tcp:101: 00010000:00010000:3.0:1787602373.624001:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602373.624200:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70800/0x576b7af90af46824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fc22 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602373.624298:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70800/0x576b7af90af46824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc22 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602373.624312:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70800/0x576b7af90af46824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc22 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602373.624338:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70800, rc 0) 00000100:00100000:3.0:1787602373.624438:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+7:5586:x1874436821090816:12345-192.168.206.25@tcp:101: Request processed in 460us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602373.624445:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 114 00000100:00100000:2.0:1787602373.632656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602373.632738:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821090944 00000100:00100000:3.0:1787602373.632751:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821090944 00000100:00100000:3.0:1787602373.632814:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 115 00000100:00100000:3.0:1787602373.632826:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+7:5586:x1874436821090944:12345-192.168.206.25@tcp:501: 00000100:00100000:3.0:1787602373.633390:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:5586:x1874436821090944:12345-192.168.206.25@tcp:501: Request processed in 563us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602373.633399:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 115 00000100:00100000:2.0:1787602373.642118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602373.642214:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821091072 00000100:00100000:3.0:1787602373.642226:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821091072 00000100:00100000:3.0:1787602373.642292:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 116 00000100:00100000:3.0:1787602373.642304:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:5586:x1874436821091072:12345-192.168.206.25@tcp:503: 00000100:00100000:3.0:1787602373.642642:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:5586:x1874436821091072:12345-192.168.206.25@tcp:503: Request processed in 339us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602373.642650:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 116 00000100:00100000:3.0:1787602373.655452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602373.655705:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821091200 00000100:00100000:2.0:1787602373.655718:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821091200 00000100:00100000:2.0:1787602373.655788:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 117 00000100:00100000:2.0:1787602373.655799:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:5604:x1874436821091200:12345-192.168.206.25@tcp:502: 00000100:00100000:2.0:1787602373.656161:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:5604:x1874436821091200:12345-192.168.206.25@tcp:502: Request processed in 362us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602373.656180:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 117 00000100:00100000:0.0:1787602373.661379:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838939520:0@lo:13: 00000100:00100000:0.0:1787602373.661466:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602373.661669:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838939520 00000100:00100000:3.0:1787602373.661679:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838939520 00000100:00100000:3.0:1787602373.661741:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787602373.661752:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838939520:12345-0@lo:13: 00002000:00000024:3.0:1787602373.661794:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602373.661848:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838939520:12345-0@lo:13: Request processed in 96us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602373.661873:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787602373.662207:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ebc4380 x1874436838939520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602373.662229:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838939520:0@lo:13: 00000100:00100000:2.0:1787602373.674312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602373.677384:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821091328 00000100:00100000:2.0:1787602373.677403:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821091328 00000100:00100000:2.0:1787602373.677467:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 118 00000100:00100000:2.0:1787602373.677480:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:5604:x1874436821091328:12345-192.168.206.25@tcp:502: 00000100:00100000:2.0:1787602373.677807:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:5604:x1874436821091328:12345-192.168.206.25@tcp:502: Request processed in 327us (3506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602373.677815:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 118 00000100:00100000:0.0:1787602373.688412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602373.689206:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821091456 00000100:00100000:3.0:1787602373.689220:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821091456 00000100:00100000:3.0:1787602373.689286:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 119 00000100:00100000:3.0:1787602373.689299:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:5586:x1874436821091456:12345-192.168.206.25@tcp:101: 00010000:00010000:3.0:1787602373.689320:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602373.689340:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d71600/0x576b7af90af4682b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fc4c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602373.689386:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71600/0x576b7af90af4682b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc4c expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602373.689398:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d71600/0x576b7af90af4682b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc4c expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602373.689408:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71600, rc 0) 00000100:00100000:3.0:1787602373.689485:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5586:x1874436821091456:12345-192.168.206.25@tcp:101: Request processed in 188us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602373.689493:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 119 00000100:00100000:2.0:1787602373.698442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602373.698525:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821091584 00000100:00100000:1.0:1787602373.698537:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821091584 00000100:00100000:1.0:1787602373.698598:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 120 00000100:00100000:1.0:1787602373.698608:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5586:x1874436821091584:12345-192.168.206.25@tcp:256: 20000000:01000000:1.0:1787602373.698638:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787602373.698667:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787602373.698672:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787602373.698675:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787602373.698678:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787602373.702768:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5586:x1874436821091584:12345-192.168.206.25@tcp:256: Request processed in 4140us (4318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602373.702786:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 120 00000100:00100000:3.0:1787602373.706544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602373.706587:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821091712 00000100:00100000:3.0:1787602373.706599:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821091712 00000100:00100000:3.0:1787602373.706660:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 121 00000100:00100000:3.0:1787602373.706674:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5586:x1874436821091712:12345-192.168.206.25@tcp:101: 00010000:00010000:3.0:1787602373.706716:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602373.706735:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d71c00/0x576b7af90af46832 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fc53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602373.706781:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71c00/0x576b7af90af46832 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc53 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602373.706794:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d71c00/0x576b7af90af46832 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc53 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602373.706805:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71c00, rc 0) 00000100:00100000:3.0:1787602373.706869:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5586:x1874436821091712:12345-192.168.206.25@tcp:101: Request processed in 198us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602373.706876:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 121 00000100:00100000:2.0:1787602373.711319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602373.712475:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821091840 00000100:00100000:2.0:1787602373.712492:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821091840 00000100:00100000:2.0:1787602373.712557:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 122 00000100:00100000:2.0:1787602373.712568:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5586:x1874436821091840:12345-192.168.206.25@tcp:501: 00000100:00100000:2.0:1787602373.712912:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5586:x1874436821091840:12345-192.168.206.25@tcp:501: Request processed in 344us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602373.712922:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 122 00000100:00100000:3.0:1787602373.716513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602373.716553:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821091968 00000100:00100000:3.0:1787602373.716564:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821091968 00000100:00100000:3.0:1787602373.716614:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 123 00000100:00100000:3.0:1787602373.716624:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5586:x1874436821091968:12345-192.168.206.25@tcp:503: 00000100:00100000:3.0:1787602373.722949:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5586:x1874436821091968:12345-192.168.206.25@tcp:503: Request processed in 6298us (6422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602373.722967:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 123 00000100:00100000:3.0:1787602373.727591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602373.727922:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821092096 00000100:00100000:0.0:1787602373.727935:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821092096 00000100:00100000:0.0:1787602373.728080:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 124 00000100:00100000:0.0:1787602373.728092:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5608:x1874436821092096:12345-192.168.206.25@tcp:502: 00000100:00100000:0.0:1787602373.728439:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5608:x1874436821092096:12345-192.168.206.25@tcp:502: Request processed in 348us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602373.728448:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 124 00000100:00100000:2.0:1787602373.731878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602373.732411:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821092224 00000100:00100000:0.0:1787602373.732424:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821092224 00000100:00100000:0.0:1787602373.732509:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 125 00000100:00100000:0.0:1787602373.732521:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5608:x1874436821092224:12345-192.168.206.25@tcp:502: 00000100:00100000:0.0:1787602373.732805:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5608:x1874436821092224:12345-192.168.206.25@tcp:502: Request processed in 285us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602373.732815:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 125 00000100:00100000:2.0:1787602373.742266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602373.748855:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821092352 00000100:00100000:3.0:1787602373.748874:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821092352 00000100:00100000:3.0:1787602373.748943:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:3.0:1787602373.748954:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1874436821092352:12345-192.168.206.25@tcp:38: 00010000:00080000:3.0:1787602373.749008:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:3.0:1787602373.749198:0:5835:0:(genops.c:1385:class_connect()) connect: client a41c7236-f364-42ee-9be0-a289b3ed94f6, cookie 0x576b7af90af46839 00000004:00100000:3.0:1787602373.749243:0:5835:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787602373.749250:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787602373.803474:0:5835:0:(import.c:65:import_set_state_nolock()) ffff944a7554a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602373.803584:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2360:x1874436821092352:12345-192.168.206.25@tcp:38: Request processed in 54628us (61329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602373.803598:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 4 00010000:00010000:3.0:1787602374.109580:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602374.818353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602374.818844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602374.818876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821092608 00000100:00100000:1.0:1787602374.818895:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821092608 00000100:00100000:1.0:1787602374.818977:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821092480 00000100:00100000:1.0:1787602374.818991:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821092480 00000100:00100000:3.0:1787602374.818995:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:3.0:1787602374.819012:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:5586:x1874436821092608:12345-192.168.206.25@tcp:41: 00000100:00080000:0.0:1787602374.819072:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1787602374.819091:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787602374.819178:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:5586:x1874436821092608:12345-192.168.206.25@tcp:41: Request processed in 170us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602374.819186:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:3.0:1787602374.819204:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:3.0:1787602374.819210:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:0:x1874436821092480:12345-192.168.206.25@tcp:41: 00000004:00000024:3.0:1787602374.819222:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787602374.819247:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:0:x1874436821092480:12345-192.168.206.25@tcp:41: Request processed in 37us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602374.819255:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:0.0:1787602374.830137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602374.831283:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821092736 00000100:00100000:1.0:1787602374.831295:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821092736 00000100:00100000:1.0:1787602374.831369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:1.0:1787602374.831381:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:5586:x1874436821092736:12345-192.168.206.25@tcp:40: 00000100:00100000:1.0:1787602374.831484:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:5586:x1874436821092736:12345-192.168.206.25@tcp:40: Request processed in 95us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602374.831492:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:0.0:1787602374.833472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602374.833755:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821093120 00000100:00100000:2.0:1787602374.833764:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821093120 00000100:00100000:2.0:1787602374.833828:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:2.0:1787602374.833839:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:5586:x1874436821093120:12345-192.168.206.25@tcp:33: 00000100:00100000:1.0:1787602374.834987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602374.835031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602374.835091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602374.835203:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821092864 00000100:00100000:2.0:1787602374.835209:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821092864 00000100:00100000:2.0:1787602374.835242:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821092992 00000100:00100000:2.0:1787602374.835244:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821092992 00000100:00100000:2.0:1787602374.835256:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:2.0:1787602374.835262:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1874436821092864:12345-192.168.206.25@tcp:8: 00010000:00080000:2.0:1787602374.835297:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1787602374.835328:0:6692:0:(genops.c:1385:class_connect()) connect: client a41c7236-f364-42ee-9be0-a289b3ed94f6, cookie 0x576b7af90af46840 00002000:00100000:2.0:1787602374.835340:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a41c7236-f364-42ee-9be0-a289b3ed94f6/ffff944a48ee5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787602374.835351:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787602374.835682:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787602374.835718:0:6692:0:(import.c:65:import_set_state_nolock()) ffff944a48ee6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602374.835793:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2360:x1874436821092864:12345-192.168.206.25@tcp:8: Request processed in 529us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602374.835802:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:2.0:1787602374.835831:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:2.0:1787602374.835836:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1874436821092992:12345-192.168.206.25@tcp:8: 00010000:00080000:2.0:1787602374.835854:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1787602374.835874:0:6692:0:(genops.c:1385:class_connect()) connect: client a41c7236-f364-42ee-9be0-a289b3ed94f6, cookie 0x576b7af90af46847 00002000:00100000:2.0:1787602374.835880:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a41c7236-f364-42ee-9be0-a289b3ed94f6/ffff944a48ee0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787602374.835897:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787602374.836145:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787602374.836188:0:6692:0:(import.c:65:import_set_state_nolock()) ffff944a7c494000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602374.836214:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2360:x1874436821092992:12345-192.168.206.25@tcp:8: Request processed in 377us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602374.836222:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:3.0:1787602374.839313:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821093248 00000100:00100000:3.0:1787602374.839327:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821093248 00000100:00100000:3.0:1787602374.839398:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 126 00000100:00100000:3.0:1787602374.839408:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2364:x1874436821093248:12345-192.168.206.25@tcp:400: 00000100:00100000:3.0:1787602374.839491:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2364:x1874436821093248:12345-192.168.206.25@tcp:400: Request processed in 84us (4510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602374.839499:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 126 00000004:00080000:2.0:1787602374.884776:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 50867us 00000004:00200000:2.0:1787602374.923023:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787602374.923598:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:5586:x1874436821093120:12345-192.168.206.25@tcp:33: Request processed in 89755us (90136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602374.923609:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 0 00010000:00010000:2.0:1787602375.133336:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602375.164141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602375.164252:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821093376 00000100:00100000:3.0:1787602375.164263:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821093376 00000100:00100000:3.0:1787602375.164329:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:3.0:1787602375.164340:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:5626:x1874436821093376:12345-192.168.206.25@tcp:101: 00010000:00010000:3.0:1787602375.164376:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602375.164405:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71400/0x576b7af90af4684e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fc7d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602375.164485:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46855 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602375.164499:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602375.164514:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602375.164719:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787602375.164724:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602375.164808:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602375.164842:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71400/0x576b7af90af4684e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc7d expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602375.164859:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46855 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc7d expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602375.164875:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a4a576300) 00010000:00010000:3.0:1787602375.164878:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602375.164881:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71a00, rc 0) 00000100:00100000:3.0:1787602375.164946:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:5626:x1874436821093376:12345-192.168.206.25@tcp:101: Request processed in 608us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602375.164954:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 8 00010000:00010000:3.0:1787602376.157341:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787602376.855080:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00010000:00010000:2.0:1787602377.181961:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602377.248437:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838939776:0@lo:400: 00000100:00100000:2.0:1787602377.248437:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838939904:0@lo:400: 00000100:00100000:0.0:1787602377.248577:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838940032:0@lo:400: 00000100:00100000:1.0:1787602377.248650:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838939648:0@lo:400: 00000100:00100000:3.0:1787602377.249132:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602377.249322:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602377.249424:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602377.249432:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838940416:0@lo:13: 00000100:00100000:0.0:1787602377.249463:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602377.249503:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838940416 00000100:00100000:0.0:1787602377.249510:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838940416 00000100:00100000:0.0:1787602377.249562:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787602377.249571:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838940416:12345-0@lo:13: 00002000:00000024:0.0:1787602377.249607:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602377.249650:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838940416:12345-0@lo:13: Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.249657:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787602377.249677:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787602377.249708:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c2d2d80 x1874436838940416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602377.249726:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838940416:0@lo:13: 00000100:00100000:1.0:1787602377.249796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602377.249839:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838940160:0@lo:400: 00000100:00100000:0.0:1787602377.249968:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838939648 00000100:00100000:0.0:1787602377.249984:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838939648 00000100:00100000:0.0:1787602377.250020:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787602377.250027:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838939648:12345-0@lo:400: 00000100:00100000:0.0:1787602377.250083:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838939648:12345-0@lo:400: Request processed in 56us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.250089:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787602377.250283:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838940032 00000100:00100000:2.0:1787602377.250288:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838940032 00000100:00100000:2.0:1787602377.250337:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787602377.250346:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838940032:12345-0@lo:400: 00000100:00100000:2.0:1787602377.250387:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838940032:12345-0@lo:400: Request processed in 44us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602377.250400:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787602377.250543:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787602377.250567:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a46253800 x1874436838940032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602377.250579:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838940032:0@lo:400: 00000100:00100000:0.0:1787602377.250899:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838939776 00000100:00100000:0.0:1787602377.250904:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838939776 00000100:00100000:3.0:1787602377.250923:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838940288:0@lo:400: 00000100:00100000:1.0:1787602377.250958:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602377.250964:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602377.251009:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838939648:0@lo:400: 00000100:00100000:0.0:1787602377.251127:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838940160 00000100:00100000:0.0:1787602377.251131:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838940160 00000100:00100000:0.0:1787602377.251166:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787602377.251173:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838939776:12345-0@lo:400: 00000100:00100000:0.0:1787602377.251209:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838939776:12345-0@lo:400: Request processed in 38us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.251216:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787602377.251274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787602377.251288:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838940160:12345-0@lo:400: 00000100:00100000:1.0:1787602377.251333:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838940160:12345-0@lo:400: Request processed in 53us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.251339:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787602377.251368:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838940160:0@lo:400: 00000100:00080000:1.0:1787602377.251400:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602377.251518:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838940288 00000100:00100000:0.0:1787602377.251522:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838940288 00000100:00100000:0.0:1787602377.251555:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602377.251563:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838940288:12345-0@lo:400: 00000100:00100000:0.0:1787602377.251597:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838940288:12345-0@lo:400: Request processed in 35us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.251603:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787602377.251704:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602377.251778:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838939904 00000100:00100000:1.0:1787602377.251782:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838939904 00000100:00100000:3.0:1787602377.251815:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838939776:0@lo:400: 00010000:00080000:3.0:1787602377.251834:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a46250380 x1874436838940288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602377.251846:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838940288:0@lo:400: 00000100:00100000:1.0:1787602377.251852:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787602377.251861:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838939904:12345-0@lo:400: 00000100:00100000:1.0:1787602377.251907:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838939904:12345-0@lo:400: Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.251914:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787602377.251964:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838939904:0@lo:400: 00000100:00080000:0.0:1787602377.252126:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602377.372587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602377.372691:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821093504 00000100:00100000:0.0:1787602377.372714:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821093504 00000100:00100000:0.0:1787602377.372799:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:0.0:1787602377.372811:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:5678:x1874436821093504:12345-192.168.206.25@tcp:41: 00000004:00000024:0.0:1787602377.372859:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787602377.372935:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:5678:x1874436821093504:12345-192.168.206.25@tcp:41: Request processed in 126us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.372943:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00080000:1.0:1787602377.373096:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602377.377676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602377.377746:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821093632 00000100:00100000:3.0:1787602377.377756:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821093632 00000100:00100000:3.0:1787602377.377837:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:3.0:1787602377.377848:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:5678:x1874436821093632:12345-192.168.206.25@tcp:13: 00002000:00000024:3.0:1787602377.377891:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602377.378103:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:5678:x1874436821093632:12345-192.168.206.25@tcp:13: Request processed in 255us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602377.378137:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00080000:1.0:1787602377.379668:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602377.380813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602377.380913:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821093760 00000100:00100000:3.0:1787602377.380923:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821093760 00000100:00080000:1.0:1787602377.381278:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602377.381499:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:3.0:1787602377.381512:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:5678:x1874436821093760:12345-192.168.206.25@tcp:13: 00002000:00000024:3.0:1787602377.381538:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602377.381601:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:5678:x1874436821093760:12345-192.168.206.25@tcp:13: Request processed in 93us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602377.381609:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 10 00010000:00010000:3.0:1787602378.205664:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602378.796936:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602378.796959:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838940544:0@lo:13: 00000100:00100000:3.0:1787602378.797027:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602378.797209:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838940544 00000100:00100000:3.0:1787602378.797217:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838940544 00000100:00100000:3.0:1787602378.797264:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602378.797274:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838940544:12345-0@lo:13: 00002000:00000024:3.0:1787602378.797297:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602378.797342:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838940544:12345-0@lo:13: Request processed in 68us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602378.797349:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787602378.797394:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ebc6300 x1874436838940544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602378.797413:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838940544:0@lo:13: 00000001:00100000:1.0:1787602378.850643:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00010000:00010000:2.0:1787602379.229302:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787602379.352203:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00000001:02000400:1.0:1787602379.949832:0:8301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787602380.035904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602380.035958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602380.036081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602380.036112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602380.036178:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821093888 00000100:00100000:3.0:1787602380.036190:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821093888 00000100:00100000:3.0:1787602380.036251:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 128 00000100:00100000:3.0:1787602380.036262:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2362:x1874436821093888:12345-192.168.206.25@tcp:400: 00000100:00100000:3.0:1787602380.036345:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2362:x1874436821093888:12345-192.168.206.25@tcp:400: Request processed in 84us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602380.036353:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 128 00000100:00100000:0.0:1787602380.038758:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821094016 00000100:00100000:0.0:1787602380.038777:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821094016 00000100:00100000:0.0:1787602380.038866:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:0.0:1787602380.038882:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821094016:12345-192.168.206.25@tcp:400: 00000100:00100000:0.0:1787602380.038970:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821094016:12345-192.168.206.25@tcp:400: Request processed in 94us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602380.038978:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:1.0:1787602380.040976:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821094144 00000100:00100000:1.0:1787602380.040991:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821094144 00000100:00100000:1.0:1787602380.041061:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821094272 00000100:00100000:1.0:1787602380.041065:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821094272 00000100:00100000:1.0:1787602380.041094:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:3.0:1787602380.041106:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:1.0:1787602380.041114:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2362:x1874436821094144:12345-192.168.206.25@tcp:400: 00000100:00100000:3.0:1787602380.041123:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2362:x1874436821094272:12345-192.168.206.25@tcp:400: 00000100:00100000:1.0:1787602380.041213:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2362:x1874436821094144:12345-192.168.206.25@tcp:400: Request processed in 108us (5253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602380.041223:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00080000:1.0:1787602380.041250:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602380.041255:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602380.041257:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602380.048090:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2362:x1874436821094272:12345-192.168.206.25@tcp:400: Request processed in 6955us (11957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602380.048111:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 8 00010000:00010000:3.0:1787602380.253454:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602381.277488:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602382.305464:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602382.365413:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838941056:0@lo:400: 00000100:00100000:1.0:1787602382.365513:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602382.365588:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602382.365594:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838940928:0@lo:400: 00000100:00100000:1.0:1787602382.365658:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602382.365725:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838941056 00000100:00100000:1.0:1787602382.365734:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838941056 00000100:00100000:1.0:1787602382.365806:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602382.365820:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838941056:12345-0@lo:400: 00000100:00100000:1.0:1787602382.365882:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838941056:12345-0@lo:400: Request processed in 66us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602382.365889:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602382.365915:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838940928 00000100:00100000:1.0:1787602382.365918:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838940928 00000100:00100000:1.0:1787602382.365945:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787602382.365951:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436838940928:12345-0@lo:400: 00000100:00100000:1.0:1787602382.365980:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436838940928:12345-0@lo:400: Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602382.365987:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787602382.366002:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602382.366007:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602382.366080:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838940928:0@lo:400: 00010000:00080000:1.0:1787602382.366111:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c484e00 x1874436838941056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602382.366122:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838941056:0@lo:400: 00000100:00100000:3.0:1787602382.366382:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838940800:0@lo:400: 00000100:00100000:3.0:1787602382.366423:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602382.366449:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838941312:0@lo:400: 00000100:00100000:3.0:1787602382.366473:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602382.366500:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787602382.366507:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838940672:0@lo:400: 00000100:00100000:3.0:1787602382.366536:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602382.366556:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838941184:0@lo:400: 00000100:00100000:3.0:1787602382.366579:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602382.366608:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838940800 00000100:00100000:3.0:1787602382.366612:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838940800 00000100:00100000:3.0:1787602382.366639:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838941184 00000100:00100000:3.0:1787602382.366653:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838941184 00000100:00100000:3.0:1787602382.366679:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787602382.366686:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838940800:12345-0@lo:400: 00000100:00100000:3.0:1787602382.366739:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838940800:12345-0@lo:400: Request processed in 53us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602382.366745:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787602382.366761:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787602382.366768:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838941184:12345-0@lo:400: 00000100:00100000:3.0:1787602382.366795:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838941184:12345-0@lo:400: Request processed in 28us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602382.366800:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787602382.366818:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838941312 00000100:00100000:3.0:1787602382.366821:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838941312 00000100:00100000:3.0:1787602382.366843:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787602382.366849:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838941312:12345-0@lo:400: 00000100:00100000:3.0:1787602382.366878:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838941312:12345-0@lo:400: Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602382.366883:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787602382.366911:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838941184:0@lo:400: 00000100:00100000:3.0:1787602382.366921:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838940800:0@lo:400: 00010000:00080000:3.0:1787602382.366930:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c485500 x1874436838941312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602382.366938:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838941312:0@lo:400: 00000100:00100000:1.0:1787602382.367231:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838940672 00000100:00100000:1.0:1787602382.367237:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838940672 00000100:00100000:1.0:1787602382.367264:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787602382.367271:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838940672:12345-0@lo:400: 00000100:00100000:1.0:1787602382.367306:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838940672:12345-0@lo:400: Request processed in 36us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602382.367313:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1787602382.367353:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602382.367357:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602382.367570:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838940672:0@lo:400: 00000100:00100000:2.0:1787602382.369988:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602382.370032:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838941440:0@lo:13: 00000100:00100000:2.0:1787602382.370159:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602382.370827:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838941440 00000100:00100000:1.0:1787602382.370839:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838941440 00000100:00100000:1.0:1787602382.370900:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787602382.370912:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838941440:12345-0@lo:13: 00002000:00000024:1.0:1787602382.370953:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602382.371018:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838941440:12345-0@lo:13: Request processed in 109us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602382.371056:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787602382.372165:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ef94700 x1874436838941440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602382.372194:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838941440:0@lo:13: 00010000:00010000:2.0:1787602383.326827:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787602383.486936:0:8448:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc91cf5d70 20000000:00000080:1.0:1787602383.486955:0:8448:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff944a6e5ba000 uarg=0000000000000000 20000000:01000000:1.0:1787602383.486992:0:8448:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787602383.486994:0:8448:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787602383.486996:0:8448:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787602383.489370:0:8448:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787602383.489383:0:8448:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787602383.489408:0:8448:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787602383.489411:0:8448:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787602383.489718:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787602383.489721:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787602383.495672:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787602383.497316:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787602383.497366:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787602383.497400:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787602383.497412:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787602383.497415:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787602383.498906:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787602383.499477:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787602383.499528:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787602383.499583:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787602383.499597:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787602383.499600:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787602383.502837:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787602383.503841:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787602383.503915:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787602383.503957:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787602383.503971:0:8448:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787602383.503974:0:8448:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787602383.507358:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787602383.507889:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787602383.507952:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787602383.507988:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1787602383.508813:0:8448:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787602383.508862:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.508882:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41486000/0x576b7af90af46759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46752 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.508891:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41477e00/0x576b7af90af46783 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4677c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.508898:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41487400/0x576b7af90af467ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af467a6 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.508905:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41487c00/0x576b7af90af467bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af467b4 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.508912:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41477200/0x576b7af90af467c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af467c2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.508920:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a5890dc00/0x576b7af90af467e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af467de expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.508928:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41486200/0x576b7af90af4680f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46808 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.508955:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41487a00/0x576b7af90af4681d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc1b expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.508963:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a47d70800/0x576b7af90af46824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc22 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.508971:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.509313:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a47d70800/0x576b7af90af46824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc22 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.509329:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a47d70800/0x576b7af90af46824 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc22 expref: 9 pid: 5828 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.509344:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838941568:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602383.509493:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41487a00/0x576b7af90af4681d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc1b expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.509501:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a41487a00/0x576b7af90af4681d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc1b expref: 9 pid: 5827 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.509510:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838941696:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602383.509543:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41486200/0x576b7af90af4680f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af46808 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.509564:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41486200/0x576b7af90af4680f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af46808 expref: 18 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.509587:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef97800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838941824:0@lo:104: 00000100:00100000:1.0:1787602383.509630:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787602383.509671:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a5890dc00/0x576b7af90af467e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af467de expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.509679:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a5890dc00/0x576b7af90af467e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af467de expref: 18 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.509687:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef97100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838941952:0@lo:104: 00000100:00100000:1.0:1787602383.509711:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787602383.509736:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41477200/0x576b7af90af467c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af467c2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.509743:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41477200/0x576b7af90af467c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af467c2 expref: 18 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.509750:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838942080:0@lo:104: 00010000:00010000:1.0:1787602383.509784:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41487c00/0x576b7af90af467bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af467b4 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.509792:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41487c00/0x576b7af90af467bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af467b4 expref: 18 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.509799:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838942208:0@lo:104: 00010000:00010000:1.0:1787602383.509825:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41487400/0x576b7af90af467ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af467a6 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.509832:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41487400/0x576b7af90af467ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af467a6 expref: 18 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.509848:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef94000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838942336:0@lo:104: 00010000:00010000:1.0:1787602383.509875:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41477e00/0x576b7af90af46783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af4677c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.509882:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41477e00/0x576b7af90af46783 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af4677c expref: 18 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.509889:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838942464:0@lo:104: 00010000:00010000:1.0:1787602383.509911:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41486000/0x576b7af90af46759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af46752 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.509918:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41486000/0x576b7af90af46759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af46752 expref: 18 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.509925:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838942592:0@lo:104: 00000100:00100000:1.0:1787602383.509943:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec82600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602383.510145:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787602383.510166:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602383.510191:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602383.510202:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602383.510210:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602383.510218:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602383.510226:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838941824 00000100:00100000:0.0:1787602383.510232:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838941824 00000100:00100000:0.0:1787602383.510277:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838941952 00000100:00100000:0.0:1787602383.510281:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838941952 00000100:00100000:0.0:1787602383.510292:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838942080 00000100:00100000:0.0:1787602383.510295:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838942080 00000100:00100000:0.0:1787602383.510303:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838942208 00000100:00100000:0.0:1787602383.510312:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838942208 00000100:00100000:0.0:1787602383.510327:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838942336 00000100:00100000:0.0:1787602383.510330:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838942336 00000100:00100000:0.0:1787602383.510339:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838942464 00000100:00100000:0.0:1787602383.510341:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838942464 00000100:00100000:0.0:1787602383.510350:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838942592 00000100:00100000:0.0:1787602383.510352:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838942592 00000100:00100000:0.0:1787602383.510365:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602383.510374:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+9:8448:x1874436838941824:12345-0@lo:104: 00010000:00010000:0.0:1787602383.510387:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.510444:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602383.510450:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+9:8448:x1874436838941824:12345-0@lo:104: Request processed in 77us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.510456:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602383.510471:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787602383.510476:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a77c18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+8:8448:x1874436838941952:12345-0@lo:104: 00010000:00010000:0.0:1787602383.510483:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.510516:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787602383.510521:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a77c18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+8:8448:x1874436838941952:12345-0@lo:104: Request processed in 46us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.510527:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787602383.510573:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787602383.510580:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+7:8448:x1874436838942080:12345-0@lo:104: 00010000:00010000:0.0:1787602383.510587:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.510624:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787602383.510629:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+7:8448:x1874436838942080:12345-0@lo:104: Request processed in 50us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.510635:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787602383.510648:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787602383.510654:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+6:8448:x1874436838942208:12345-0@lo:104: 00010000:00010000:0.0:1787602383.510660:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.510686:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787602383.510691:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+6:8448:x1874436838942208:12345-0@lo:104: Request processed in 38us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.510696:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787602383.510707:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787602383.510712:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+5:8448:x1874436838942336:12345-0@lo:104: 00010000:00010000:0.0:1787602383.510719:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.510745:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787602383.510750:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+5:8448:x1874436838942336:12345-0@lo:104: Request processed in 39us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.510756:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787602383.510767:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787602383.510773:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+4:8448:x1874436838942464:12345-0@lo:104: 00010000:00010000:0.0:1787602383.510780:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.510811:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787602383.510816:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+4:8448:x1874436838942464:12345-0@lo:104: Request processed in 44us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.510822:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787602383.510833:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787602383.510838:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+3:8448:x1874436838942592:12345-0@lo:104: 00010000:00010000:0.0:1787602383.510845:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.510871:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787602383.510876:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+3:8448:x1874436838942592:12345-0@lo:104: Request processed in 38us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.510881:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787602383.510904:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787602383.510911:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.510918:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41486400 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602383.510922:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.510930:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602383.510937:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602383.510943:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602383.510982:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.510988:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602383.511008:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511021:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41486400/0x576b7af90af46808 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4680f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511062:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787602383.511066:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511073:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890da00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602383.511077:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511084:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602383.511091:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602383.511097:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602383.511110:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511128:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602383.511146:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511164:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5890da00/0x576b7af90af467de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467e5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511174:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787602383.511177:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511183:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602383.511186:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511194:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602383.511202:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602383.511207:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787602383.511214:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787602383.511224:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511231:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602383.511237:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.511243:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838942720:0@lo:103: 00010000:00010000:0.0:1787602383.511245:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a47d71000/0x576b7af90af467c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511260:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787602383.511269:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511276:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890d600 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602383.511279:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511286:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.511288:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1787602383.511297:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602383.511303:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602383.511335:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.511340:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838942848:0@lo:103: 00010000:00010000:0.0:1787602383.511344:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602383.511358:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511365:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af467a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511374:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602383.511377:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511382:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890d000 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602383.511385:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511401:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602383.511407:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602383.511413:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787602383.511430:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602383.511432:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511439:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602383.511447:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511453:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5890d000/0x576b7af90af4677c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46783 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.511456:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787602383.511463:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787602383.511465:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838942976:0@lo:103: 00010000:00010000:0.0:1787602383.511468:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511474:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71e00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602383.511479:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511487:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602383.511493:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.511506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787602383.511513:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602383.511530:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511536:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602383.511545:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511551:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a47d71e00/0x576b7af90af46752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46759 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511560:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602383.511562:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602383.511563:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602383.511585:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838943104:0@lo:103: 00000100:00100000:0.0:1787602383.511613:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602383.511632:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602383.511637:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838943232:0@lo:103: 00000100:00100000:0.0:1787602383.511657:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602383.511673:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787602383.511680:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838943360:0@lo:103: 00000100:00100000:0.0:1787602383.511701:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602383.511722:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838942720 00000100:00100000:2.0:1787602383.511727:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838942848 00000100:00100000:0.0:1787602383.511728:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838942720 00000100:00100000:2.0:1787602383.511735:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838942848 00010000:00010000:0.0:1787602383.511756:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41486200/0x576b7af90af4680f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46808 expref: 20 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.511759:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a5890dc00/0x576b7af90af467e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af467de expref: 20 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602383.511784:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838942976 00000100:00100000:2.0:1787602383.511787:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838943104 00000100:00100000:2.0:1787602383.511790:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838943104 00000100:00100000:0.0:1787602383.511795:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838942976 00010000:00010000:2.0:1787602383.511804:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41487400/0x576b7af90af467ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af467a6 expref: 22 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511816:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41477200/0x576b7af90af467c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af467c2 expref: 22 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.511819:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838943232 00000100:00100000:2.0:1787602383.511823:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838943232 00000100:00100000:0.0:1787602383.511838:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838943360 00010000:00010000:2.0:1787602383.511842:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41477e00/0x576b7af90af46783 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af4677c expref: 23 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602383.511844:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838943360 00010000:00010000:0.0:1787602383.511861:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41486000/0x576b7af90af46759 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46752 expref: 24 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.511865:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787602383.511878:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+24:3312:x1874436838942720:12345-0@lo:103: 00000100:00100000:0.0:1787602383.511885:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787602383.511890:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787602383.511895:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46253800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+24:3313:x1874436838942848:12345-0@lo:103: 00010000:00010000:2.0:1787602383.511899:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41486200/0x576b7af90af4680f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46808 expref: 24 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511907:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602383.511911:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41486200/0x576b7af90af4680f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af46808 expref: 24 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.511915:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a5890dc00/0x576b7af90af467e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af467de expref: 24 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602383.512182:0:7636:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1787602383.512198:0:7636:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1787602383.514017:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41486200/0x576b7af90af4680f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af46808 expref: 24 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.514054:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef97800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838941824:0@lo:104: 00000100:00100000:1.0:1787602383.514067:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef97100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838941952:0@lo:104: 00000100:00100000:1.0:1787602383.514076:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838942080:0@lo:104: 00000100:00100000:1.0:1787602383.514084:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838942208:0@lo:104: 00000100:00100000:1.0:1787602383.514093:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef94000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838942336:0@lo:104: 00000100:00100000:1.0:1787602383.514101:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838942464:0@lo:104: 00000100:00100000:1.0:1787602383.514108:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838942592:0@lo:104: 00010000:00010000:0.0:1787602383.515849:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a5890dc00/0x576b7af90af467e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af467de expref: 23 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.515877:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890dc00/0x576b7af90af467e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af467de expref: 23 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.515895:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602383.515973:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46253800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+22:3313:x1874436838942848:12345-0@lo:103: Request processed in 4079us (4541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.515983:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787602383.516020:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787602383.516051:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+21:3311:x1874436838943104:12345-0@lo:103: 00010000:00010000:0.0:1787602383.516071:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602383.516078:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41487400/0x576b7af90af467ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af467a6 expref: 21 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516105:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41487400/0x576b7af90af467ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af467a6 expref: 21 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516130:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41487400/0x576b7af90af467ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af467a6 expref: 21 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516144:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602383.516179:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+20:3311:x1874436838943104:12345-0@lo:103: Request processed in 151us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.516185:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787602383.516199:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787602383.516207:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838942976:12345-0@lo:103: 00010000:00010000:0.0:1787602383.516216:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602383.516221:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41477200/0x576b7af90af467c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af467c2 expref: 19 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516230:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41477200/0x576b7af90af467c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af467c2 expref: 19 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516239:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41477200/0x576b7af90af467c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af467c2 expref: 19 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516248:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602383.516272:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:3313:x1874436838942976:12345-0@lo:103: Request processed in 67us (4769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.516278:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787602383.516293:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787602383.516302:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:3311:x1874436838943232:12345-0@lo:103: 00010000:00010000:0.0:1787602383.516316:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602383.516322:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41477e00/0x576b7af90af46783 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af4677c expref: 17 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516331:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41477e00/0x576b7af90af46783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af4677c expref: 17 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516342:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41477e00/0x576b7af90af46783 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af4677c expref: 17 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516350:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602383.516375:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+16:3311:x1874436838943232:12345-0@lo:103: Request processed in 75us (4717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.516382:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787602383.516397:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787602383.516404:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:3314:x1874436838943360:12345-0@lo:103: 00010000:00010000:0.0:1787602383.516412:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602383.516417:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41486000/0x576b7af90af46759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46752 expref: 15 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516425:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41486000/0x576b7af90af46759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af46752 expref: 15 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516435:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41486000/0x576b7af90af46759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af46752 expref: 15 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.516446:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602383.516481:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:3314:x1874436838943360:12345-0@lo:103: Request processed in 77us (4779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602383.516497:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787602383.516872:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838943232:0@lo:103: 00000100:00100000:3.0:1787602383.516885:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838943104:0@lo:103: 00000100:00100000:1.0:1787602383.517001:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838943360:0@lo:103: 00010000:00010000:3.0:1787602383.517424:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602383.517427:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602383.517429:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602383.517466:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.517476:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477c00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:1.0:1787602383.517480:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.517489:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602383.517497:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602383.517503:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787602383.517817:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602383.517924:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.517931:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602383.517953:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.517959:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41477c00/0x576b7af90af467b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af467bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.517974:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602383.517976:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602383.517977:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602383.520156:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838941568:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602383.520174:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8448:1874436838941696:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602383.520235:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602383.520385:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+13:3312:x1874436838942720:12345-0@lo:103: Request processed in 8508us (9094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602383.520397:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787602383.520660:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838942720:0@lo:103: 00000100:00100000:0.0:1787602383.520854:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838943488:0@lo:103: 00000100:00100000:0.0:1787602383.520901:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602383.520960:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838943488 00000100:00100000:1.0:1787602383.520968:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838943488 00010000:00010000:1.0:1787602383.520998:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41487c00/0x576b7af90af467bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af467b4 expref: 13 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602383.521025:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787602383.521052:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:3314:x1874436838943488:12345-0@lo:103: 00010000:00010000:1.0:1787602383.521067:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602383.521073:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41487c00/0x576b7af90af467bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af467b4 expref: 13 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.521083:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41487c00/0x576b7af90af467bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af467b4 expref: 13 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.521101:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41487c00/0x576b7af90af467bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af467b4 expref: 13 pid: 5827 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.521129:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602383.521168:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:3314:x1874436838943488:12345-0@lo:103: Request processed in 135us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602383.521175:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787602383.521505:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838942976:0@lo:103: 00000100:00100000:2.0:1787602383.521519:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838942848:0@lo:103: 00000100:00100000:3.0:1787602383.522065:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838943488:0@lo:103: 00000100:00100000:3.0:1787602383.526583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602383.526633:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602383.526789:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821094400 00000100:00100000:0.0:1787602383.526799:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821094400 00010000:00010000:0.0:1787602383.526843:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a47d70800/0x576b7af90af46824 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc22 expref: 10 pid: 5828 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.526888:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821094528 00000100:00100000:0.0:1787602383.526893:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:0.0:1787602383.526906:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2362:x1874436821094400:12345-192.168.206.25@tcp:103: 00000100:00100000:2.0:1787602383.526908:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821094528 00010000:00010000:0.0:1787602383.526924:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602383.526931:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41487a00/0x576b7af90af4681d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc1b expref: 11 pid: 5827 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.526933:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a47d70800/0x576b7af90af46824 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc22 expref: 11 pid: 5828 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602383.526956:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a47d70800/0x576b7af90af46824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc22 expref: 11 pid: 5828 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.526967:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 20 00010000:00010000:0.0:1787602383.526979:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d70800/0x576b7af90af46824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc22 expref: 11 pid: 5828 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.526980:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:2362:x1874436821094528:12345-192.168.206.25@tcp:103: 00010000:00010000:2.0:1787602383.526994:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602383.527002:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602383.527007:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41487a00/0x576b7af90af4681d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc1b expref: 10 pid: 5827 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.527020:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41487a00/0x576b7af90af4681d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc1b expref: 10 pid: 5827 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.527034:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41487a00/0x576b7af90af4681d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc1b expref: 10 pid: 5827 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.527072:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.527081:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602383.527091:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:2362:x1874436821094400:12345-192.168.206.25@tcp:103: Request processed in 187us (516us total) trans 0 rc 0/0 00010000:00010000:2.0:1787602383.527098:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602383.527101:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 19 00010000:00010000:2.0:1787602383.527111:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.527131:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.527149:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.527417:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602383.527423:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.527432:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.527454:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602383.527467:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602383.527495:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:2362:x1874436821094528:12345-192.168.206.25@tcp:103: Request processed in 519us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602383.527502:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 20 00010000:00010000:1.0:1787602383.528409:0:8448:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.528424:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602383.528441:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41487200/0x576b7af90af4685c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602383.901742:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602383.901768:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838943616:0@lo:13: 00000100:00100000:2.0:1787602383.901841:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602383.904555:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838943616 00000100:00100000:3.0:1787602383.904571:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838943616 00000100:00100000:3.0:1787602383.904634:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787602383.904644:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838943616:12345-0@lo:13: 00002000:00000024:3.0:1787602383.904683:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602383.904762:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838943616:12345-0@lo:13: Request processed in 119us (2920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602383.904769:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787602383.910820:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ebc5880 x1874436838943616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602383.910846:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838943616:0@lo:13: 00010000:00010000:0.0:1787602384.350977:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787602384.669284:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787602384.669293:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944945805800 from 39 10000000:01000000:3.0:1787602384.669298:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787602384.669349:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.669361:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.669392:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602384.669417:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838943744:0@lo:101: 00000100:00100000:3.0:1787602384.669489:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602384.669561:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787602384.669710:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838943744 00000100:00100000:0.0:1787602384.669719:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838943744 00000100:00100000:0.0:1787602384.669770:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787602384.669789:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+12:5830:x1874436838943744:12345-0@lo:101: 00010000:00010000:0.0:1787602384.669802:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602384.669817:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5890dc00/0x576b7af90af4686a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46863 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602384.669840:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890dc00/0x576b7af90af4686a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46863 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602384.669851:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5890dc00/0x576b7af90af4686a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46863 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602384.669861:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890dc00, rc 0) 00000100:00100000:0.0:1787602384.669908:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838943744:12345-0@lo:101: Request processed in 121us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602384.669914:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787602384.670687:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838943744:0@lo:101: 00010000:00010000:3.0:1787602384.670707:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.670716:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602384.670776:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838943872:0@lo:501: 00000100:00100000:3.0:1787602384.670816:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602384.670850:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc1900 going to sleep for 11 seconds 00000100:00100000:1.0:1787602384.671263:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838943872 00000100:00100000:1.0:1787602384.671271:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838943872 00000100:00100000:1.0:1787602384.671322:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787602384.671333:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838943872:12345-0@lo:501: 00000100:00100000:1.0:1787602384.671618:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838943872:12345-0@lo:501: Request processed in 286us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.671626:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787602384.671904:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838943872:0@lo:501: 00000100:00100000:3.0:1787602384.671945:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838944000:0@lo:503: 00000100:00100000:3.0:1787602384.672001:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602384.672100:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787602384.674852:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838944000 00000100:00100000:2.0:1787602384.674869:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838944000 00000100:00100000:2.0:1787602384.675015:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787602384.675026:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838944000:12345-0@lo:503: 00000100:00100000:2.0:1787602384.675321:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838944000:12345-0@lo:503: Request processed in 296us (3319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602384.675329:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787602384.675437:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838944000:0@lo:503: 00000100:00100000:3.0:1787602384.675914:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8468:1874436838944128:0@lo:502: 00000100:00100000:3.0:1787602384.675977:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602384.682027:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787602384.687704:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838944128 00000100:00100000:0.0:1787602384.687719:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838944128 00000100:00100000:0.0:1787602384.687783:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787602384.687794:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:8468:x1874436838944128:12345-0@lo:502: 00000100:00100000:0.0:1787602384.688153:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:8468:x1874436838944128:12345-0@lo:502: Request processed in 360us (12175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602384.688161:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787602384.688194:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8468:1874436838944128:0@lo:502: 00000100:00100000:3.0:1787602384.688277:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8468:1874436838944256:0@lo:502: 00000100:00100000:3.0:1787602384.688324:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602384.688360:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787602384.688478:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838944256 00000100:00100000:2.0:1787602384.688483:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838944256 00000100:00100000:2.0:1787602384.688507:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787602384.688514:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:8468:x1874436838944256:12345-0@lo:502: 00000100:00100000:2.0:1787602384.688789:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+13:8468:x1874436838944256:12345-0@lo:502: Request processed in 275us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602384.688796:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787602384.691982:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8468:1874436838944256:0@lo:502: 00000040:00080000:3.0:1787602384.692066:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787602384.692216:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787602384.692234:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787602384.692249:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.692260:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602384.692270:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787602384.692273:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787602384.692277:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787602384.692316:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.692324:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.692334:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602384.692364:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838944384:0@lo:101: 00000100:00100000:1.0:1787602384.692425:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.692506:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602384.695945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838944384 00000100:00100000:0.0:1787602384.696338:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838944384 00000100:00100000:0.0:1787602384.696493:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787602384.696505:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+13:5830:x1874436838944384:12345-0@lo:101: 00010000:00010000:0.0:1787602384.696523:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602384.696543:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5890d000/0x576b7af90af46878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46871 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602384.696599:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890d000/0x576b7af90af46878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46871 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602384.696610:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5890d000/0x576b7af90af46878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46871 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602384.696620:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890d000, rc 0) 00000100:00100000:0.0:1787602384.696750:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838944384:12345-0@lo:101: Request processed in 248us (4325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602384.696757:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787602384.698139:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838944384:0@lo:101: 00010000:00010000:1.0:1787602384.698167:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.698179:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602384.703410:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838944512:0@lo:501: 00000100:00100000:1.0:1787602384.703501:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.703541:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602384.705391:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838944512 00000100:00100000:2.0:1787602384.705407:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838944512 00000100:00100000:2.0:1787602384.705482:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787602384.705493:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838944512:12345-0@lo:501: 00000100:00100000:2.0:1787602384.707801:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838944512:12345-0@lo:501: Request processed in 2300us (4292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602384.707817:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787602384.708748:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838944512:0@lo:501: 00000100:00100000:3.0:1787602384.708815:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838944640:0@lo:503: 00000100:00100000:3.0:1787602384.708888:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602384.708992:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602384.710602:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838944640 00000100:00100000:1.0:1787602384.710615:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838944640 00000100:00100000:1.0:1787602384.710777:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787602384.710790:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838944640:12345-0@lo:503: 00000100:00100000:1.0:1787602384.711087:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838944640:12345-0@lo:503: Request processed in 299us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.711094:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787602384.711625:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838944640:0@lo:503: 00000100:00100000:2.0:1787602384.712531:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8469:1874436838944768:0@lo:502: 00000100:00100000:2.0:1787602384.712676:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602384.712814:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfc600 going to sleep for 11 seconds 00000100:00100000:1.0:1787602384.713243:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838944768 00000100:00100000:1.0:1787602384.713260:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838944768 00000100:00100000:1.0:1787602384.713307:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787602384.713317:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:8469:x1874436838944768:12345-0@lo:502: 00000100:00100000:1.0:1787602384.713542:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:8469:x1874436838944768:12345-0@lo:502: Request processed in 226us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.713571:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787602384.713905:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8469:1874436838944768:0@lo:502: 00000020:01000000:2.0:1787602384.713937:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602384.713948:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602384.713950:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787602384.713966:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787602384.714003:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8469:1874436838944896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602384.714064:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602384.714094:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfc600 going to sleep for 11 seconds 00000100:00100000:1.0:1787602384.714794:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838944896 00000100:00100000:1.0:1787602384.714802:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838944896 00000100:00100000:1.0:1787602384.714846:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787602384.714855:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:8469:x1874436838944896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602384.715075:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:8469:x1874436838944896:12345-0@lo:502:llog_process_th.0 Request processed in 219us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.715082:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787602384.715247:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8469:1874436838944896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602384.715283:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602384.715289:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602384.715291:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787602384.715295:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787602384.715516:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787602384.715536:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787602384.715556:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.715568:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602384.715579:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787602384.715582:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944a576b9000 from 39 10000000:01000000:1.0:1787602384.715585:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787602384.715615:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.715623:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.715633:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602384.715650:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.715689:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.715732:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec82c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602384.715892:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838945024 00000100:00100000:2.0:1787602384.715897:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838945024 00000100:00100000:2.0:1787602384.715930:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787602384.715938:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:5830:x1874436838945024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602384.715949:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602384.715971:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41476c00/0x576b7af90af46886 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4687f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602384.715993:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41476c00/0x576b7af90af46886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4687f expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602384.716004:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41476c00/0x576b7af90af46886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4687f expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602384.716014:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476c00, rc 0) 00000100:00100000:2.0:1787602384.716066:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838945024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602384.716072:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787602384.718196:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602384.718225:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.718236:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602384.718320:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.718370:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.718408:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec82c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602384.718532:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838945152 00000100:00100000:2.0:1787602384.718539:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838945152 00000100:00100000:2.0:1787602384.718590:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787602384.718611:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838945152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602384.718877:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838945152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602384.718884:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787602384.719405:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.719444:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.719489:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.719521:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec82c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602384.719648:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838945280 00000100:00100000:0.0:1787602384.719655:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838945280 00000100:00100000:1.0:1787602384.719918:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787602384.719926:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838945280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.720136:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838945280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.720144:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787602384.720184:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.737970:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8470:1874436838945408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602384.738081:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.738143:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602384.738207:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838945408 00000100:00100000:3.0:1787602384.738216:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838945408 00000100:00100000:3.0:1787602384.738269:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787602384.738280:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:8470:x1874436838945408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602384.738570:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:8470:x1874436838945408:12345-0@lo:502:llog_process_th.0 Request processed in 291us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602384.738583:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787602384.738661:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8470:1874436838945408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602384.738711:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8470:1874436838945536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602384.738745:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.738775:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602384.738833:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838945536 00000100:00100000:0.0:1787602384.738838:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838945536 00000100:00100000:0.0:1787602384.738871:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787602384.738879:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+15:8470:x1874436838945536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602384.739063:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+15:8470:x1874436838945536:12345-0@lo:502:llog_process_th.0 Request processed in 184us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602384.739069:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787602384.739213:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8470:1874436838945536:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787602384.739240:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787602384.739437:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787602384.739468:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787602384.739479:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.739492:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602384.739501:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787602384.739504:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787602384.739508:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787602384.739534:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.739543:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.739552:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602384.739566:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.739599:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.739631:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec82cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602384.739730:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838945664 00000100:00100000:3.0:1787602384.739734:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838945664 00000100:00100000:3.0:1787602384.739772:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787602384.739778:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+15:5830:x1874436838945664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602384.739788:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602384.739801:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70a00/0x576b7af90af46894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4688d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.739836:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70a00/0x576b7af90af46894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4688d expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.739846:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70a00/0x576b7af90af46894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4688d expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.739855:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70a00, rc 0) 00000100:00100000:3.0:1787602384.739895:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838945664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602384.739901:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787602384.740220:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602384.740244:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.740253:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602384.740316:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.740345:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.740376:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec82cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602384.740640:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838945792 00000100:00100000:2.0:1787602384.740646:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838945792 00000100:00100000:2.0:1787602384.740802:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787602384.740813:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838945792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602384.741086:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838945792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602384.741123:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602384.741158:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602384.741198:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602384.741226:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838945920 00000100:00100000:3.0:1787602384.741229:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602384.741231:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838945920 00000100:00100000:2.0:1787602384.743283:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787602384.745283:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787602384.745306:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838945920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602384.745780:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838945920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 483us (4579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602384.745788:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787602384.745904:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838945920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602384.746916:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8471:1874436838946048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602384.747332:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602384.747408:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfc540 going to sleep for 11 seconds 00000100:00100000:2.0:1787602384.747444:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838946048 00000100:00100000:2.0:1787602384.747451:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838946048 00000100:00100000:2.0:1787602384.747535:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787602384.747615:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:8471:x1874436838946048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602384.747884:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:8471:x1874436838946048:12345-0@lo:502:llog_process_th.0 Request processed in 340us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602384.747893:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787602384.748133:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8471:1874436838946048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787602384.748164:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602384.748174:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602384.748176:0:8471:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787602384.748183:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787602384.748213:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8471:1874436838946176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602384.748326:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602384.748404:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602384.748475:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838946176 00000100:00100000:2.0:1787602384.748480:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838946176 00000100:00100000:2.0:1787602384.748513:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787602384.748522:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:8471:x1874436838946176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602384.748816:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:8471:x1874436838946176:12345-0@lo:502:llog_process_th.0 Request processed in 294us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602384.748834:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787602384.749390:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8471:1874436838946176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787602384.749419:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602384.749427:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602384.749429:0:8471:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787602384.749433:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787602384.749685:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787602384.749706:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787602384.749718:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.749729:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602384.749739:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787602384.749742:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944a487a1000 from 39 10000000:01000000:1.0:1787602384.749746:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787602384.749775:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.749782:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.749791:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602384.749811:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838946304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.749860:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.749926:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec82780 going to sleep for 11 seconds 00000100:00100000:3.0:1787602384.750184:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838946304 00000100:00100000:3.0:1787602384.750191:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838946304 00000100:00100000:3.0:1787602384.750349:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787602384.750359:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838946304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602384.750371:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602384.750384:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70600/0x576b7af90af468a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4689b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.750408:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70600/0x576b7af90af468a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4689b expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.750419:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70600/0x576b7af90af468a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4689b expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.750428:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70600, rc 0) 00000100:00100000:3.0:1787602384.750475:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838946304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602384.750482:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787602384.750563:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838946304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602384.750578:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.750586:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602384.750635:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838946432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.750663:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.750818:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec82780 going to sleep for 11 seconds 00000100:00100000:2.0:1787602384.750917:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838946432 00000100:00100000:2.0:1787602384.750923:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838946432 00000100:00100000:2.0:1787602384.750946:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787602384.750964:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838946432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602384.751245:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838946432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602384.751262:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787602384.751442:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838946432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.751475:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838946560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.751518:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.751558:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec82780 going to sleep for 11 seconds 00000100:00100000:3.0:1787602384.751686:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838946560 00000100:00100000:3.0:1787602384.751692:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838946560 00000100:00100000:3.0:1787602384.751714:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787602384.751720:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838946560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602384.751873:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838946560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602384.751887:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787602384.752079:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838946560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602384.752800:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8472:1874436838946688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602384.752852:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602384.752913:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602384.755667:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838946688 00000100:00100000:1.0:1787602384.755684:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838946688 00000100:00100000:1.0:1787602384.755803:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787602384.755815:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:8472:x1874436838946688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602384.756171:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:8472:x1874436838946688:12345-0@lo:502:llog_process_th.0 Request processed in 358us (3318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.756179:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787602384.756291:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8472:1874436838946688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602384.756358:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8472:1874436838946816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602384.756404:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602384.756873:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602384.756942:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838946816 00000100:00100000:3.0:1787602384.756950:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838946816 00000100:00100000:3.0:1787602384.756981:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787602384.756988:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:8472:x1874436838946816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602384.757218:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:8472:x1874436838946816:12345-0@lo:502:llog_process_th.0 Request processed in 230us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602384.757226:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787602384.757359:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8472:1874436838946816:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787602384.757385:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787602384.758094:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787602384.758127:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787602384.758138:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602384.758150:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602384.758160:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787602384.758163:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787602384.758167:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787602384.758201:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602384.758214:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602384.758224:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602384.758243:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838946944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602384.758302:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602384.758343:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602384.759399:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838946944 00000100:00100000:1.0:1787602384.759421:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838946944 00000100:00100000:1.0:1787602384.759473:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787602384.759483:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838946944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602384.759498:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602384.759514:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41487000/0x576b7af90af468b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af468a9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.759542:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41487000/0x576b7af90af468b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af468a9 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.759632:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41487000/0x576b7af90af468b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af468a9 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.759641:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487000, rc 0) 00000100:00100000:1.0:1787602384.759757:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838946944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 275us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.759763:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787602384.760346:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838946944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602384.760366:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602384.760376:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602384.760516:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838947072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602384.760619:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602384.760685:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfc900 going to sleep for 11 seconds 00000100:00100000:1.0:1787602384.760721:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838947072 00000100:00100000:1.0:1787602384.760726:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838947072 00000100:00100000:1.0:1787602384.760787:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787602384.760795:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838947072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.761144:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838947072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.761151:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787602384.761389:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838947072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602384.761419:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838947200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602384.761458:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602384.761518:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfc900 going to sleep for 11 seconds 00000100:00100000:0.0:1787602384.761623:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838947200 00000100:00100000:0.0:1787602384.761629:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838947200 00000100:00100000:0.0:1787602384.761697:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787602384.761706:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838947200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602384.761868:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838947200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602384.761874:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787602384.761952:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838947200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.762538:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8473:1874436838947328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602384.762668:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.762740:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6ec82e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602384.762783:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838947328 00000100:00100000:0.0:1787602384.762788:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838947328 00000100:00100000:0.0:1787602384.762857:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787602384.762866:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:8473:x1874436838947328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602384.763634:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:8473:x1874436838947328:12345-0@lo:502:llog_process_th.0 Request processed in 766us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602384.763643:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787602384.763722:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8473:1874436838947328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602384.763754:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602384.763763:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602384.763766:0:8473:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787602384.763771:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787602384.763803:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8473:1874436838947456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602384.763844:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602384.764458:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838947456 00000100:00100000:1.0:1787602384.764474:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838947456 00000100:00100000:1.0:1787602384.764508:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787602384.764516:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:8473:x1874436838947456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602384.764961:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:8473:x1874436838947456:12345-0@lo:502:llog_process_th.0 Request processed in 444us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.764969:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787602384.765210:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfc900 going to sleep for 11 seconds 00000100:00100000:3.0:1787602384.765233:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8473:1874436838947456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787602384.765336:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602384.765345:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602384.765348:0:8473:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787602384.765353:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787602384.765689:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787602384.765717:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787602384.765726:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602384.765735:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602384.765744:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787602384.765746:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff944a4560cd28 from 1 10000000:01000000:2.0:1787602384.765749:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787602384.765781:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41476e00/0x576b7af90af468b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602384.765789:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41476e00/0x576b7af90af468b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602384.765797:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41476e00/0x576b7af90af468b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602384.765812:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838947584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787602384.765848:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602384.765901:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787602384.765938:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838947584 00000100:00100000:1.0:1787602384.765944:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838947584 00000100:00100000:1.0:1787602384.766012:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787602384.766021:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838947584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602384.766148:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602384.766163:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41486800/0x576b7af90af468be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af468b7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.766190:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41486800/0x576b7af90af468be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af468b7 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.766199:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41486800/0x576b7af90af468be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af468b7 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602384.766209:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41486800, rc 0) 00000100:00100000:1.0:1787602384.766357:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838947584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 337us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.766363:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787602384.766517:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838947584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602384.766531:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41476e00/0x576b7af90af468b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.766541:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41476e00/0x576b7af90af468b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af468be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602384.766675:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838947712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602384.766706:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602384.766780:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602384.766813:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838947712 00000100:00100000:1.0:1787602384.766818:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838947712 00000100:00100000:1.0:1787602384.766851:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787602384.766859:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838947712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.767625:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838947712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 689us (839us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602384.767635:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787602384.767722:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838947712:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787602384.767752:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787602384.767759:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41476e00/0x576b7af90af468b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.767768:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41476e00/0x576b7af90af468b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602384.835372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602384.835513:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821094656 00000100:00100000:2.0:1787602384.835528:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821094656 00000100:00100000:2.0:1787602384.835592:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 162 00000100:00100000:2.0:1787602384.835604:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:5600:x1874436821094656:12345-192.168.206.25@tcp:101: 00010000:00010000:2.0:1787602384.835627:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602384.835650:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41477000/0x576b7af90af468c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fc84 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602384.835720:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41477000/0x576b7af90af468c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc84 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602384.835733:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41477000/0x576b7af90af468c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc84 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602384.835744:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477000, rc 0) 00000100:00100000:2.0:1787602384.835813:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5600:x1874436821094656:12345-192.168.206.25@tcp:101: Request processed in 211us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602384.835821:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 162 00000100:00100000:2.0:1787602384.845019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602384.853222:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821094784 00000100:00100000:1.0:1787602384.853244:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821094784 00000100:00100000:1.0:1787602384.853345:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 163 00000100:00100000:1.0:1787602384.853359:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5600:x1874436821094784:12345-192.168.206.25@tcp:501: 00000100:00100000:1.0:1787602384.853815:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5600:x1874436821094784:12345-192.168.206.25@tcp:501: Request processed in 457us (8808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.853826:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 163 00000100:00100000:2.0:1787602384.857643:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602384.858086:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821094912 00000100:00100000:3.0:1787602384.858100:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821094912 00000100:00100000:3.0:1787602384.858179:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 164 00000100:00100000:3.0:1787602384.858190:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5600:x1874436821094912:12345-192.168.206.25@tcp:503: 00000100:00100000:3.0:1787602384.858473:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5600:x1874436821094912:12345-192.168.206.25@tcp:503: Request processed in 282us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602384.858481:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 164 00000100:00100000:3.0:1787602384.869788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602384.870090:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821095040 00000100:00100000:1.0:1787602384.870105:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821095040 00000100:00100000:1.0:1787602384.870175:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 165 00000100:00100000:1.0:1787602384.870188:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:6072:x1874436821095040:12345-192.168.206.25@tcp:502: 00000100:00100000:1.0:1787602384.870529:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:6072:x1874436821095040:12345-192.168.206.25@tcp:502: Request processed in 342us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.870538:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 165 00000100:00100000:2.0:1787602384.872591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602384.872935:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821095168 00000100:00100000:1.0:1787602384.872947:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821095168 00000100:00100000:1.0:1787602384.873193:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 166 00000100:00100000:1.0:1787602384.873204:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:6072:x1874436821095168:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787602384.873508:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:6072:x1874436821095168:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 305us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602384.873516:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 166 00000100:00100000:0.0:1787602384.877579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602384.877704:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821095296 00000100:00100000:3.0:1787602384.877717:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821095296 00000100:00100000:3.0:1787602384.877787:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 167 00000100:00100000:3.0:1787602384.877800:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5600:x1874436821095296:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602384.877822:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602384.877843:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70e00/0x576b7af90af468cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fc8b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.877880:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70e00/0x576b7af90af468cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc8b expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.877916:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70e00/0x576b7af90af468cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc8b expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602384.877928:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70e00, rc 0) 00000100:00100000:3.0:1787602384.878019:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5600:x1874436821095296:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 Request processed in 221us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602384.878028:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 167 00000100:00100000:3.0:1787602384.881619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602384.881736:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821095424 00000100:00100000:1.0:1787602384.881765:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821095424 00000100:00100000:1.0:1787602384.881831:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 168 00000100:00100000:1.0:1787602384.881844:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5600:x1874436821095424:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602384.882252:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5600:x1874436821095424:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 Request processed in 410us (645us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602384.882262:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 168 00000100:00100000:0.0:1787602385.157005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602385.157098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602385.157150:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602385.157170:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821095936 00000100:00100000:1.0:1787602385.157183:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821095936 00000100:00100000:2.0:1787602385.157192:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821095552 00000100:00100000:2.0:1787602385.157199:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821095552 00000100:00100000:0.0:1787602385.157201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602385.157304:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821095680 00000100:00100000:3.0:1787602385.157310:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821095680 00000100:00100000:3.0:1787602385.157358:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 23 00000100:00100000:3.0:1787602385.157372:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821095680:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602385.157470:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821095680:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 101us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602385.157478:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 23 00000100:00080000:0.0:1787602385.157539:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787602385.157545:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602385.162460:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821095808 00000100:00100000:1.0:1787602385.162483:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821095808 00000100:00080000:0.0:1787602385.162620:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602385.163096:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:2.0:1787602385.163153:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 169 00000100:00100000:2.0:1787602385.163169:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2361:x1874436821095552:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602385.163365:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821095936:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602385.163869:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2361:x1874436821095552:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 702us (6714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602385.163878:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 169 00000100:00100000:1.0:1787602385.165658:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787602385.167073:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787602385.167332:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00100000:1.0:1787602385.167353:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821095808:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602385.169321:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821095936:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 6195us (12206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602385.169341:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:1.0:1787602385.182261:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821095808:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 14898us (25041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602385.182280:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 12 00010000:00010000:3.0:1787602385.373306:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602386.400610:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787602386.750853:0:8512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfdfc63d0 20000000:00000080:1.0:1787602386.750871:0:8512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff944a6e5bac00 uarg=0000000000000000 20000000:01000000:1.0:1787602386.750909:0:8512:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787602386.750915:0:8512:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787602386.750920:0:8512:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787602386.755584:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787602386.755782:0:8512:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787602386.771757:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787602386.771819:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787602386.771873:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787602386.771891:0:8512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787602386.771911:0:8512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.771929:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a5890c600/0x576b7af90af46648 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46641 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.771937:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41477600/0x576b7af90af466aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af466a3 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.771944:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a47d71800/0x576b7af90af46775 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4676e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.771954:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a47d71c00/0x576b7af90af46832 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc53 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.771961:0:8512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.772001:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a47d71c00/0x576b7af90af46832 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc53 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.772016:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a47d71c00/0x576b7af90af46832 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc53 expref: 9 pid: 5827 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602386.772031:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874436838947840:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602386.772186:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a47d71800/0x576b7af90af46775 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af4676e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.772195:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a47d71800/0x576b7af90af46775 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af4676e expref: 18 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602386.772840:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874436838947968:0@lo:104: 00000100:00100000:0.0:1787602386.772892:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602386.772974:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41477600/0x576b7af90af466aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af466a3 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.772985:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41477600/0x576b7af90af466aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af466a3 expref: 18 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602386.772994:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874436838948096:0@lo:104: 00000100:00100000:0.0:1787602386.773022:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602386.778422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602386.781813:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821096064 00000100:00100000:2.0:1787602386.781832:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821096064 00010000:00010000:2.0:1787602386.781885:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a47d71c00/0x576b7af90af46832 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc53 expref: 10 pid: 5827 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602386.781950:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00100000:2.0:1787602386.781959:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2362:x1874436821096064:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602386.781974:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602386.781979:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a47d71c00/0x576b7af90af46832 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc53 expref: 10 pid: 5827 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602386.781992:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a47d71c00/0x576b7af90af46832 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc53 expref: 10 pid: 5827 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602386.782014:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602386.782094:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2362:x1874436821096064:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 135us (3682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602386.782111:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 21 00010000:00010000:0.0:1787602386.787081:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a5890c600/0x576b7af90af46648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af46641 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.787110:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a5890c600/0x576b7af90af46648 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af46641 expref: 18 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602386.787126:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874436838948224:0@lo:104: 00000100:00100000:0.0:1787602386.787173:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1f00 going to sleep for 11 seconds 00010000:00010000:0.0:1787602386.787590:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d71c00/0x576b7af90af46832 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc53 expref: 9 pid: 5827 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602386.787608:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874436838947840:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602386.787775:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787602386.787802:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602386.789581:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838947968 00000100:00100000:3.0:1787602386.789584:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838948096 00000100:00100000:3.0:1787602386.789595:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838948096 00000100:00100000:1.0:1787602386.789596:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838947968 00000100:00100000:3.0:1787602386.789655:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838948224 00000100:00100000:3.0:1787602386.789658:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838948224 00000100:00100000:3.0:1787602386.789676:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787602386.789845:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+5:8512:x1874436838948096:12345-0@lo:104: 00010000:00010000:3.0:1787602386.789935:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.790027:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787602386.790052:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+5:8512:x1874436838948096:12345-0@lo:104: Request processed in 350us (17011us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602386.790059:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1787602386.790086:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602386.790172:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.790181:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487e00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:3.0:1787602386.790185:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.790194:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602386.790202:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602386.790207:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787602386.790243:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.790249:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602386.790277:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.790284:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41487e00/0x576b7af90af466a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af466aa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.790300:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602386.790302:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602386.790304:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602386.790329:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838948352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602386.790380:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787602386.790397:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+4:8512:x1874436838948224:12345-0@lo:104: 00010000:00010000:0.0:1787602386.790407:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41477800/0x576b7af90af46641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602386.790432:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602386.790467:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602386.790475:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+4:8512:x1874436838948224:12345-0@lo:104: Request processed in 80us (2672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602386.790482:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787602386.790493:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838948352 00000100:00100000:3.0:1787602386.790499:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838948352 00000100:00100000:0.0:1787602386.790503:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787602386.790513:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+3:8512:x1874436838947968:12345-0@lo:104: 00010000:00010000:0.0:1787602386.790524:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.790525:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41477600/0x576b7af90af466aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af466a3 expref: 19 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790575:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787602386.790576:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787602386.790587:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+3:8512:x1874436838947968:12345-0@lo:104: Request processed in 73us (17693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602386.790591:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838948352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602386.790599:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787602386.790607:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602386.790614:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41477600/0x576b7af90af466aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af466a3 expref: 19 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.790626:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41477600/0x576b7af90af466aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af466a3 expref: 19 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790642:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787602386.790646:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602386.790648:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41477800/0x576b7af90af46641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790658:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477800 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602386.790662:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41477800/0x576b7af90af46641 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790670:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41477800/0x576b7af90af46641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602386.790676:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838948352:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (243us total) trans 0 rc 0/0 10000000:00010000:0.0:1787602386.790686:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41477800/0x576b7af90af46641 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602386.790699:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787602386.790720:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41477800/0x576b7af90af46641 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790727:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602386.790743:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41477800/0x576b7af90af46641 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790749:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41477800/0x576b7af90af46641 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46648 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790759:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602386.790762:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790767:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487800 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602386.790770:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790776:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602386.790782:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602386.790787:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787602386.790799:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790805:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602386.790817:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790822:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41487800/0x576b7af90af4676e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46775 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.790835:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602386.790837:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602386.790839:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602386.790850:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838948480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602386.790879:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602386.790902:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787602386.790908:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838948608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602386.790930:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602386.790955:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838948480 00000100:00100000:0.0:1787602386.790959:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838948480 00010000:00010000:0.0:1787602386.790978:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a5890c600/0x576b7af90af46648 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46641 expref: 20 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602386.790979:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787602386.790999:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838948608 00000100:00100000:3.0:1787602386.791009:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838948608 00000100:00100000:0.0:1787602386.791010:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787602386.791021:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+20:3313:x1874436838948480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602386.791027:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a47d71800/0x576b7af90af46775 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af4676e expref: 20 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602386.791031:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602386.791062:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a5890c600/0x576b7af90af46648 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46641 expref: 20 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602386.791074:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787602386.791075:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a5890c600/0x576b7af90af46648 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af46641 expref: 20 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602386.791084:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+20:3313:x1874436838948608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787602386.791089:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602386.791131:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+20:3313:x1874436838948480:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602386.791144:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787602386.791171:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602386.791179:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a47d71800/0x576b7af90af46775 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af4676e expref: 19 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602386.791186:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838948480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602386.791192:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a47d71800/0x576b7af90af46775 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af4676e expref: 19 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.791207:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.791216:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.791231:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.791239:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.791245:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.791252:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.791258:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890da00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602386.791261:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602386.791270:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.791278:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.791288:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602386.791297:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602386.791335:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838948608:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602386.791342:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787602386.791405:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838948608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602386.791437:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838948352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602386.792177:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d71800/0x576b7af90af46775 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af4676e expref: 18 pid: 5826 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602386.792333:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874436838947968:0@lo:104: 00010000:00010000:1.0:1787602386.792351:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41477600/0x576b7af90af466aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af466a3 expref: 17 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602386.792360:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874436838948096:0@lo:104: 00010000:00010000:1.0:1787602386.792371:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890c600/0x576b7af90af46648 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af46641 expref: 16 pid: 5827 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602386.792379:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874436838948224:0@lo:104: 00010000:00010000:1.0:1787602386.792406:0:8512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602386.792414:0:8512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602386.792419:0:8512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602386.792425:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890da00/0x576b7af90af468d3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602387.424512:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602387.485435:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838949120:0@lo:400:kworker.0 00000100:00100000:0.0:1787602387.485450:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838949248:0@lo:400:kworker.0 00000100:00100000:2.0:1787602387.485510:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838948992:0@lo:400:kworker.0 00000100:00100000:3.0:1787602387.485523:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838948736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602387.486634:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602387.486743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838949120 00000100:00100000:1.0:1787602387.486751:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838949120 00000100:00100000:1.0:1787602387.487872:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787602387.487889:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838949120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602387.487971:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838949120:12345-0@lo:400:kworker.0 Request processed in 90us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602387.487979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787602387.488003:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602387.488047:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838949120:0@lo:400:kworker.0 00000100:00100000:0.0:1787602387.490687:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602387.491214:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838949248 00000100:00100000:1.0:1787602387.491224:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838949248 00000100:00100000:1.0:1787602387.491308:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787602387.491320:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838949248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602387.491403:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838949248:12345-0@lo:400:kworker.0 Request processed in 85us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602387.491410:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787602387.491451:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6e48d180 x1874436838949248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602387.491465:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838949248:0@lo:400:kworker.0 00000100:00080000:0.0:1787602387.491607:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602387.492432:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.492479:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838949504:0@lo:400:kworker.0 00000100:00100000:0.0:1787602387.492513:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838948992 00000100:00100000:2.0:1787602387.492516:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602387.492519:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838948992 00000100:00100000:0.0:1787602387.492560:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787602387.492568:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838948992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602387.492626:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838948992:12345-0@lo:400:kworker.0 Request processed in 58us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602387.492634:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787602387.492702:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838949504 00000100:00100000:1.0:1787602387.492706:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838949504 00000100:00100000:1.0:1787602387.492785:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787602387.492793:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838949504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602387.492831:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838949504:12345-0@lo:400:kworker.0 Request processed in 40us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602387.492837:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787602387.492891:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602387.493082:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.493145:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838948992:0@lo:400:kworker.0 00000100:00100000:3.0:1787602387.493154:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838948864:0@lo:400:kworker.0 00010000:00080000:2.0:1787602387.493157:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6e48d500 x1874436838949504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602387.493167:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838949504:0@lo:400:kworker.0 00000100:00100000:3.0:1787602387.493185:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602387.493206:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838949376:0@lo:400:kworker.0 00000100:00100000:3.0:1787602387.493228:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.493459:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838948864 00000100:00100000:2.0:1787602387.493464:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838948864 00000100:00100000:2.0:1787602387.493501:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787602387.493520:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:3311:x1874436838948864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602387.493558:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:3311:x1874436838948864:12345-0@lo:400:kworker.0 Request processed in 39us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602387.493564:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787602387.493641:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838948736 00000100:00100000:1.0:1787602387.493645:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838948736 00000100:00100000:3.0:1787602387.493877:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838948864:0@lo:400:kworker.0 00000100:00100000:1.0:1787602387.493956:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787602387.493966:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838948736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602387.494001:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602387.494073:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838948736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (991us total) trans 0 rc 0/0 00010000:00080000:3.0:1787602387.494080:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ef95880 x1874436838948736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602387.494080:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602387.494106:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838948736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602387.494285:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838949376 00000100:00100000:0.0:1787602387.494290:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838949376 00000100:00100000:0.0:1787602387.494485:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787602387.494493:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838949376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602387.494543:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838949376:12345-0@lo:400:kworker.0 Request processed in 51us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602387.494550:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787602387.494579:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602387.494608:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838949376:0@lo:400:kworker.0 10000000:01000000:3.0:1787602387.869169:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787602387.869178:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944945805800 from 4 10000000:01000000:3.0:1787602387.869184:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787602387.869236:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602387.869250:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602387.869262:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602387.869287:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838949632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787602387.869357:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602387.869414:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602387.869485:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838949632 00000100:00100000:1.0:1787602387.869493:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838949632 00000100:00100000:1.0:1787602387.869548:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787602387.869558:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838949632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602387.869571:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602387.869586:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41486400/0x576b7af90af468e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af468da expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602387.869610:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41486400/0x576b7af90af468e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af468da expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602387.869619:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41486400/0x576b7af90af468e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af468da expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602387.869629:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41486400, rc 0) 00000100:00100000:1.0:1787602387.869685:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838949632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602387.869692:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787602387.869930:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838949632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602387.869946:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602387.869967:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602387.870027:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838949760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602387.870111:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602387.870139:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787602387.870167:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838949760 00000100:00100000:2.0:1787602387.870174:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838949760 00000100:00100000:2.0:1787602387.870199:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787602387.870206:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838949760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.870453:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838949760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602387.870460:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787602387.870597:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838949760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602387.870636:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838949888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602387.870694:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602387.870720:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944946fc1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602387.870731:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838949888 00000100:00100000:1.0:1787602387.870735:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838949888 00000100:00100000:1.0:1787602387.870767:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787602387.870774:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838949888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602387.870927:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838949888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602387.870941:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787602387.871298:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838949888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602387.872168:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8543:1874436838950016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602387.872216:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602387.872247:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602387.873775:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838950016 00000100:00100000:3.0:1787602387.873797:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838950016 00000100:00100000:3.0:1787602387.873843:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787602387.873853:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:8543:x1874436838950016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602387.874152:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:8543:x1874436838950016:12345-0@lo:502:llog_process_th.0 Request processed in 299us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602387.874160:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787602387.874277:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8543:1874436838950016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602387.874314:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602387.874325:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602387.874333:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787602387.874342:0:8543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944945805800 00000020:00000080:0.0:1787602387.874345:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787602387.874439:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8543:1874436838950144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602387.874481:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602387.874514:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602387.874627:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838950144 00000100:00100000:2.0:1787602387.874633:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838950144 00000100:00100000:2.0:1787602387.874748:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787602387.874755:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:8543:x1874436838950144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602387.874897:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:8543:x1874436838950144:12345-0@lo:502:llog_process_th.0 Request processed in 141us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602387.874905:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787602387.875022:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8543:1874436838950144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602387.875071:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602387.875077:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602387.875078:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787602387.875082:0:8543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787602387.875299:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787602387.875318:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787602387.875330:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.875342:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602387.875354:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787602387.875362:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a576b9000 from 4 10000000:01000000:2.0:1787602387.875365:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787602387.875394:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.875402:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.875411:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602387.875425:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838950272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.875460:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.875493:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a754280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602387.875610:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838950272 00000100:00100000:0.0:1787602387.875616:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838950272 00000100:00100000:0.0:1787602387.875723:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787602387.875732:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838950272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602387.875742:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602387.875754:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5890ca00/0x576b7af90af468ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af468e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602387.875777:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890ca00/0x576b7af90af468ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af468e8 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602387.875786:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5890ca00/0x576b7af90af468ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af468e8 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602387.875796:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890ca00, rc 0) 00000100:00100000:0.0:1787602387.875830:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838950272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602387.875836:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787602387.875917:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838950272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602387.875931:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.875940:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602387.876089:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838950400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.876127:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.876149:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a754280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602387.876206:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838950400 00000100:00100000:0.0:1787602387.876211:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838950400 00000100:00100000:0.0:1787602387.876237:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787602387.876243:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838950400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602387.876464:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838950400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602387.876471:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787602387.876745:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838950400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.876773:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838950528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.876810:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.876831:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a754280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602387.877164:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838950528 00000100:00100000:0.0:1787602387.877170:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838950528 00000100:00100000:0.0:1787602387.877240:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787602387.877249:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838950528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602387.877410:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838950528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602387.877417:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787602387.882732:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838950528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.882985:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8545:1874436838950656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602387.883070:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.883116:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838950656 00000100:00100000:2.0:1787602387.883122:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838950656 00000100:00100000:2.0:1787602387.883160:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787602387.883169:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:8545:x1874436838950656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602387.883379:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:8545:x1874436838950656:12345-0@lo:502:llog_process_th.0 Request processed in 209us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602387.883387:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787602387.883433:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602387.883446:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8545:1874436838950656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602387.883469:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602387.883478:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602387.883481:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787602387.883487:0:8545:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944a576b9000 00000020:00000080:2.0:1787602387.883489:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787602387.883954:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8545:1874436838950784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602387.883994:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.884018:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838950784 00000100:00100000:2.0:1787602387.884022:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838950784 00000100:00100000:2.0:1787602387.884060:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787602387.884067:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:8545:x1874436838950784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602387.884203:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:8545:x1874436838950784:12345-0@lo:502:llog_process_th.0 Request processed in 136us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602387.884211:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787602387.884251:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602387.884265:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8545:1874436838950784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602387.884284:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602387.884288:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602387.884290:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787602387.884293:0:8545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787602387.884344:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787602387.884358:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787602387.884369:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.884380:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602387.884390:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787602387.884394:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a487a1000 from 4 10000000:01000000:2.0:1787602387.884397:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787602387.884423:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.884430:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.884438:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602387.884450:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838950912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.884476:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.884492:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602387.884504:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838950912 00000100:00100000:2.0:1787602387.884512:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838950912 00000100:00100000:2.0:1787602387.884528:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787602387.884533:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838950912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602387.884540:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602387.884551:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41477e00/0x576b7af90af468fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af468f6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.884570:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41477e00/0x576b7af90af468fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af468f6 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.884581:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41477e00/0x576b7af90af468fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af468f6 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.884590:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477e00, rc 0) 00000100:00100000:2.0:1787602387.884618:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838950912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602387.884624:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787602387.884650:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838950912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602387.884662:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.884670:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602387.884707:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838951040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.884732:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.884745:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602387.884755:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838951040 00000100:00100000:2.0:1787602387.884763:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838951040 00000100:00100000:2.0:1787602387.884781:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787602387.884786:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838951040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.884979:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838951040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602387.884986:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787602387.885013:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838951040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.885056:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838951168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.885088:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.885119:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602387.885130:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838951168 00000100:00100000:2.0:1787602387.885133:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838951168 00000100:00100000:2.0:1787602387.885149:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787602387.885155:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838951168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602387.885264:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838951168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602387.885270:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787602387.885302:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838951168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602387.894075:0:8546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8546:1874436838951296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602387.894171:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602387.894219:0:8546:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787602387.894224:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838951296 00000100:00100000:3.0:1787602387.894232:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838951296 00000100:00100000:3.0:1787602387.894284:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787602387.894295:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:8546:x1874436838951296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602387.894513:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:8546:x1874436838951296:12345-0@lo:502:llog_process_th.0 Request processed in 219us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602387.894522:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787602387.894717:0:8546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8546:1874436838951296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602387.894744:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602387.894753:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602387.894756:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787602387.894762:0:8546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944a487a1000 00000020:00000080:0.0:1787602387.894765:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787602387.894889:0:8546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8546:1874436838951424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602387.894924:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602387.894947:0:8546:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602387.895772:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838951424 00000100:00100000:1.0:1787602387.895846:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838951424 00000100:00100000:1.0:1787602387.895900:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787602387.895909:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:8546:x1874436838951424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602387.896132:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:8546:x1874436838951424:12345-0@lo:502:llog_process_th.0 Request processed in 224us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602387.896140:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787602387.896338:0:8546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:8546:1874436838951424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602387.896371:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602387.896378:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602387.896381:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787602387.896385:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787602387.896767:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787602387.896788:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787602387.896799:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602387.896811:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602388.445732:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602388.547802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602388.551779:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821096192 00000100:00100000:2.0:1787602388.551792:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821096192 00000100:00100000:2.0:1787602388.551897:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 186 00000100:00100000:2.0:1787602388.551910:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:5600:x1874436821096192:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602388.551930:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602388.551964:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41476400/0x576b7af90af46904 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fc92 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602388.551993:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41476400/0x576b7af90af46904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc92 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602388.552005:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41476400/0x576b7af90af46904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc92 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602388.552014:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476400, rc 0) 00000100:00100000:2.0:1787602388.552106:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5600:x1874436821096192:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 Request processed in 198us (4312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602388.552113:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 186 00000100:00100000:3.0:1787602388.556265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602388.556397:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821096320 00000100:00100000:1.0:1787602388.556407:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821096320 00000100:00100000:1.0:1787602388.556468:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 187 00000100:00100000:1.0:1787602388.556478:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5600:x1874436821096320:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602388.556748:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5600:x1874436821096320:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 Request processed in 271us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602388.556757:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 187 00000100:00100000:2.0:1787602388.563357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602388.563394:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821096448 00000100:00100000:2.0:1787602388.563402:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821096448 00000100:00100000:2.0:1787602388.563446:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 188 00000100:00100000:2.0:1787602388.563454:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5600:x1874436821096448:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602388.563687:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:5600:x1874436821096448:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 Request processed in 232us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602388.563695:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 188 00000100:00100000:0.0:1787602388.574834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602388.575534:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821096576 00000100:00100000:3.0:1787602388.575545:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821096576 00000100:00100000:3.0:1787602388.575606:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 189 00000100:00100000:3.0:1787602388.575617:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:6135:x1874436821096576:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787602388.575887:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:6135:x1874436821096576:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 271us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602388.575896:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 189 00000100:00100000:3.0:1787602388.583005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602388.594217:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821096704 00000100:00100000:0.0:1787602388.594232:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821096704 00000100:00100000:1.0:1787602388.594358:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 190 00000100:00100000:1.0:1787602388.594371:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:6135:x1874436821096704:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787602388.594654:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:6135:x1874436821096704:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 279us (11652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602388.594663:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 190 00000100:00100000:2.0:1787602389.021329:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838951552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602389.021405:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602389.026666:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838951552 00000100:00100000:2.0:1787602389.026680:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838951552 00000100:00100000:2.0:1787602389.026766:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787602389.026777:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838951552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602389.026816:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602389.026896:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838951552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (5491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602389.026903:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787602389.026970:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ebc4e00 x1874436838951552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602389.026998:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838951552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787602389.027364:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787602389.469443:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602390.288782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602390.289070:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821096960 00000100:00100000:1.0:1787602390.289089:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821096960 00000100:00100000:2.0:1787602390.289129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602390.289155:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 27 00000100:00100000:2.0:1787602390.289163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602390.289166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821096960:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602390.289201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00080000:3.0:1787602390.289257:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602390.289331:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821096960:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 166us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602390.289340:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 27 00000100:00100000:1.0:1787602390.289366:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821097216 00000100:00100000:1.0:1787602390.289370:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821097216 00000100:00100000:1.0:1787602390.289398:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821097088 00000100:00100000:1.0:1787602390.289401:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821097088 00000100:00100000:1.0:1787602390.289420:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:1.0:1787602390.289426:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2363:x1874436821097216:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602390.289815:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:2.0:1787602390.289841:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2363:x1874436821097088:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602390.290077:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2363:x1874436821097088:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 48us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602390.290094:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:1.0:1787602390.290264:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2363:x1874436821097216:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 836us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602390.290272:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:1.0:1787602390.290298:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821096832 00000100:00100000:1.0:1787602390.290303:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821096832 00000100:00100000:1.0:1787602390.290334:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 191 00000100:00100000:1.0:1787602390.290341:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2363:x1874436821096832:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602390.290369:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2363:x1874436821096832:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 28us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602390.290376:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 191 00000100:00080000:1.0:1787602390.290409:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602390.290413:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787602390.493797:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602391.521692:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602392.542292:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602392.605355:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838951680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602392.605441:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602392.607109:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838951680 00000100:00100000:3.0:1787602392.607126:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838951680 00000100:00100000:3.0:1787602392.607199:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787602392.607209:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838951680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602392.607257:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602392.607331:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838951680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602392.607339:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787602392.607519:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787602392.607574:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ebc4e00 x1874436838951680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602392.607595:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838951680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602392.607977:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838951808:0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.608021:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602392.608091:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838952320:0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.608135:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602392.608160:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602392.608166:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838951936:0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.608188:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602392.608220:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838951808 00000100:00100000:3.0:1787602392.608226:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838951808 00000100:00100000:3.0:1787602392.608263:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787602392.608271:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3311:x1874436838951808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.608311:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3311:x1874436838951808:12345-0@lo:400:kworker.0 Request processed in 41us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602392.608319:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787602392.608347:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838952320 00000100:00100000:3.0:1787602392.608351:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838952320 00000100:00100000:3.0:1787602392.608395:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838951936 00000100:00100000:3.0:1787602392.608398:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838951936 00000100:00100000:3.0:1787602392.608412:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787602392.608418:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838952320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.608452:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838952320:12345-0@lo:400:kworker.0 Request processed in 34us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602392.608457:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787602392.608467:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787602392.608472:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838951936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.608497:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838951936:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602392.608503:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787602392.608530:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838952064:0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.608554:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602392.608571:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602392.608576:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838952192:0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.608600:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602392.608628:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838952192 00000100:00100000:3.0:1787602392.608631:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838952192 00000100:00100000:3.0:1787602392.608663:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787602392.608670:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838952192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.608708:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838952192:12345-0@lo:400:kworker.0 Request processed in 38us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602392.608714:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787602392.608897:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602392.608902:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787602392.608923:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ebc4380 x1874436838952192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602392.608945:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838952192:0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.608966:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838952064 00000100:00100000:3.0:1787602392.608969:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838952064 00000100:00100000:3.0:1787602392.609009:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787602392.609016:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838952064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.609083:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838952064:12345-0@lo:400:kworker.0 Request processed in 67us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602392.609089:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787602392.609117:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838952064:0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.609138:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838951936:0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.609145:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838951808:0@lo:400:kworker.0 00000100:00100000:3.0:1787602392.609153:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838952320:0@lo:400:kworker.0 00000100:00080000:0.0:1787602392.610826:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787602393.322591:0:8813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787602393.566154:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602394.141931:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787602394.142181:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838952448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602394.142244:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602394.142843:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838952448 00000100:00100000:3.0:1787602394.142852:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838952448 00000100:00100000:3.0:1787602394.142920:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787602394.142932:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838952448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602394.142981:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787602394.143191:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787602394.143248:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c657480 x1874436838952448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602394.143270:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838952448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602394.143958:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838952448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602394.143968:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787602394.589321:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602395.402614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602395.402725:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821097344 00000100:00100000:1.0:1787602395.402735:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821097344 00000100:00100000:1.0:1787602395.402797:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 193 00000100:00100000:1.0:1787602395.402809:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2361:x1874436821097344:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602395.402888:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2361:x1874436821097344:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602395.402896:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 193 00000100:00100000:1.0:1787602395.404772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602395.404890:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821097472 00000100:00100000:3.0:1787602395.404898:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821097472 00000100:00100000:3.0:1787602395.405030:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 31 00000100:00100000:3.0:1787602395.405142:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821097472:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602395.405275:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821097472:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 137us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602395.405283:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 31 00000100:00080000:0.0:1787602395.405377:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602395.412148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602395.412192:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602395.412338:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821097728 00000100:00100000:1.0:1787602395.412348:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821097728 00000100:00100000:1.0:1787602395.412420:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821097600 00000100:00100000:1.0:1787602395.412423:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821097600 00000100:00100000:1.0:1787602395.412447:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00100000:1.0:1787602395.412457:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2362:x1874436821097728:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602395.412531:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2362:x1874436821097728:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 75us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602395.412538:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00100000:1.0:1787602395.412555:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:1.0:1787602395.412562:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2362:x1874436821097600:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602395.412587:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2362:x1874436821097600:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602395.412594:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00080000:0.0:1787602395.413079:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602395.413084:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787602395.615633:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602396.637535:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602397.662864:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602397.725658:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838952832:0@lo:400:kworker.0 00000100:00100000:1.0:1787602397.725754:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602397.725830:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602397.725854:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838952960:0@lo:400:kworker.0 00000100:00100000:1.0:1787602397.725886:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602397.725933:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838952960 00000100:00100000:1.0:1787602397.725942:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838952960 00000100:00100000:1.0:1787602397.726027:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787602397.726074:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838952960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602397.726135:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838952960:12345-0@lo:400:kworker.0 Request processed in 98us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602397.726142:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787602397.726165:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787602397.726196:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ef97b80 x1874436838952960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602397.726212:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838952960:0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.727132:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838952576:0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.727191:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602397.727239:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838953088:0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.727267:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602397.727295:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787602397.727301:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838952704:0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.727320:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602397.727338:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838953216:0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.727360:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602397.727396:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838952832 00000100:00100000:3.0:1787602397.727402:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838952832 00000100:00100000:3.0:1787602397.727457:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838953088 00000100:00100000:3.0:1787602397.727461:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838953088 00000100:00100000:3.0:1787602397.727475:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838952704 00000100:00100000:3.0:1787602397.727478:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838952704 00000100:00100000:3.0:1787602397.727494:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787602397.727501:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838952832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.727551:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838952832:12345-0@lo:400:kworker.0 Request processed in 50us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602397.727558:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787602397.727700:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787602397.727708:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838953088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.727756:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838953088:12345-0@lo:400:kworker.0 Request processed in 50us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602397.727762:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787602397.727775:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787602397.727781:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838952704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.727807:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838952704:12345-0@lo:400:kworker.0 Request processed in 27us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602397.727813:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787602397.727831:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838953216 00000100:00100000:3.0:1787602397.727835:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838953216 00000100:00100000:3.0:1787602397.727865:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787602397.727871:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838953216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.727902:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838953216:12345-0@lo:400:kworker.0 Request processed in 32us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602397.727907:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787602397.727935:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602397.727939:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602397.727965:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838952704:0@lo:400:kworker.0 00010000:00080000:3.0:1787602397.727978:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ef97100 x1874436838953216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602397.727987:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838953216:0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.728552:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838953088:0@lo:400:kworker.0 00000100:00100000:3.0:1787602397.728763:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838952832:0@lo:400:kworker.0 00000100:00100000:1.0:1787602397.728855:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838952576 00000100:00100000:1.0:1787602397.728862:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838952576 00000100:00100000:1.0:1787602397.728910:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787602397.728918:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838952576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602397.728981:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838952576:12345-0@lo:400:kworker.0 Request processed in 64us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602397.728987:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787602397.729284:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602397.730304:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838953344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602397.730368:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602397.730513:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838952576:0@lo:400:kworker.0 00000100:00100000:1.0:1787602397.738992:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838953344 00000100:00100000:1.0:1787602397.739013:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838953344 00000100:00100000:1.0:1787602397.739115:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787602397.739138:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838953344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602397.739187:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602397.739308:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838953344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (8939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602397.739320:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787602397.739442:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944947d6b100 x1874436838953344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602397.739468:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838953344:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787602398.688013:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787602398.973536:0:9057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing yml_node 00000100:00100000:2.0:1787602399.264498:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787602399.264523:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838953472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602399.264593:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602399.264783:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838953472 00000100:00100000:0.0:1787602399.264792:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838953472 00000100:00100000:0.0:1787602399.264859:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787602399.264870:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838953472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602399.264919:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602399.264968:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838953472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602399.264975:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787602399.265012:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ef97b80 x1874436838953472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602399.265057:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838953472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787602399.265440:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602399.709231:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602400.527297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602400.527350:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602400.527469:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821097856 00000100:00100000:3.0:1787602400.527482:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821097856 00000100:00100000:3.0:1787602400.527541:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 195 00000100:00100000:0.0:1787602400.527544:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821097984 00000100:00100000:0.0:1787602400.527549:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821097984 00000100:00100000:3.0:1787602400.527552:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2364:x1874436821097856:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602400.527602:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:0.0:1787602400.527609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821097984:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602400.527617:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2364:x1874436821097856:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 68us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602400.527624:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 195 00000100:00100000:0.0:1787602400.527639:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821097984:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.527645:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00080000:2.0:1787602400.527825:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602400.531580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602400.531624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602400.531798:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821098112 00000100:00100000:0.0:1787602400.531807:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821098112 00000100:00100000:2.0:1787602400.531829:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821098240 00000100:00100000:2.0:1787602400.531835:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821098240 00000100:00080000:1.0:1787602400.532232:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602400.532236:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602400.532426:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:0.0:1787602400.532438:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2360:x1874436821098112:12345-192.168.206.25@tcp:9:kworker.0 00000020:00000080:0.0:1787602400.532479:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46840 00000100:00080000:0.0:1787602400.532489:0:6694:0:(import.c:65:import_set_state_nolock()) ffff944a48ee6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787602400.532529:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787602400.534116:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+2:2360:x1874436821098112:12345-192.168.206.25@tcp:9:kworker.0 Request processed in 444us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.534193:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 10 00010000:00010000:3.0:1787602400.534849:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602400.535371:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:2.0:1787602400.535388:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2360:x1874436821098240:12345-192.168.206.25@tcp:9:kworker.0 00000020:00000080:2.0:1787602400.535424:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46847 00000100:00080000:2.0:1787602400.535436:0:6692:0:(import.c:65:import_set_state_nolock()) ffff944a7c494000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787602400.535515:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787602400.536304:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+2:2360:x1874436821098240:12345-192.168.206.25@tcp:9:kworker.0 Request processed in 920us (4674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602400.536314:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 11 00010000:00010000:1.0:1787602400.536379:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602400.733363:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602401.757473:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787602402.383193:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:1.0:1787602402.383204:0:6717:0:(genops.c:885:class_export_put()) final put ffff944a48ee5800/a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:1.0:1787602402.383277:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a48ee5800/a41c7236-f364-42ee-9be0-a289b3ed94f6 for lustre-OST0000 00000020:00000080:1.0:1787602402.383335:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a48ee6000 for lustre-OST0000 00010000:00010000:1.0:1787602402.781210:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787602402.844971:0:9251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.82 00000100:00100000:3.0:1787602402.846358:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838953600:0@lo:400:kworker.0 00000100:00100000:1.0:1787602402.846426:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838953856:0@lo:400:kworker.0 00000100:00100000:2.0:1787602402.846560:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838953728:0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.849960:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602402.849960:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602402.850084:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838953984:0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.850140:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602402.850437:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838953856 00000100:00100000:3.0:1787602402.850447:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838953856 00000100:00100000:3.0:1787602402.850519:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787602402.850530:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838953856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.850593:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838953856:12345-0@lo:400:kworker.0 Request processed in 65us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602402.850601:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787602402.850629:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838953984 00000100:00100000:3.0:1787602402.850647:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838953984 00000100:00100000:3.0:1787602402.850678:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787602402.850684:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838953984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.850843:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838953984:12345-0@lo:400:kworker.0 Request processed in 159us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602402.850851:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787602402.850932:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602402.850938:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602402.851033:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602402.851482:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838953856:0@lo:400:kworker.0 00000100:00100000:1.0:1787602402.851510:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838954368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602402.851551:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602402.851603:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838954368 00000100:00100000:1.0:1787602402.851609:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838954368 00000100:00100000:1.0:1787602402.851653:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787602402.851663:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838954368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602402.851699:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602402.851742:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838954368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602402.851748:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787602402.851790:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944947d68000 x1874436838954368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602402.851809:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838954368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602402.852212:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838953728 00000100:00100000:3.0:1787602402.852219:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838953728 00000100:00100000:3.0:1787602402.852259:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787602402.852267:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838953728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.852320:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838953728:12345-0@lo:400:kworker.0 Request processed in 53us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602402.852327:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787602402.852349:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602402.852380:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838954112:0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.852412:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787602402.852457:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ef94700 x1874436838953984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602402.852469:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838953984:0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.852491:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838954112 00000100:00100000:3.0:1787602402.852496:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838954112 00000100:00100000:3.0:1787602402.852526:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787602402.852551:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838954112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.852590:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838954112:12345-0@lo:400:kworker.0 Request processed in 41us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602402.852608:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787602402.852623:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602402.852743:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838954112:0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.852769:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838953728:0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.852777:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838954240:0@lo:400:kworker.0 00000100:00100000:3.0:1787602402.852805:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602402.853177:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838953600 00000100:00100000:0.0:1787602402.853183:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838953600 00000100:00100000:0.0:1787602402.853213:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787602402.853220:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838953600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602402.853311:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838953600:12345-0@lo:400:kworker.0 Request processed in 91us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602402.853318:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787602402.853348:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838954240 00000100:00100000:0.0:1787602402.853351:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838954240 00000100:00100000:0.0:1787602402.853374:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787602402.853380:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838954240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602402.853411:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838954240:12345-0@lo:400:kworker.0 Request processed in 31us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602402.853417:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787602402.853510:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ef95180 x1874436838954240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602402.853522:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838954240:0@lo:400:kworker.0 00000100:00100000:2.0:1787602402.853572:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838953600:0@lo:400:kworker.0 00010000:00010000:1.0:1787602403.805217:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602404.382825:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602404.395465:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838954496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602404.395577:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602404.395852:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838954496 00000100:00100000:0.0:1787602404.395863:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838954496 00000100:00080000:1.0:1787602404.396060:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602404.396455:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787602404.396472:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838954496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602404.396518:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602404.396608:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838954496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602404.396615:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787602404.396780:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944947d69c00 x1874436838954496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602404.396803:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838954496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787602404.830282:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787602404.961971:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:2.0:1787602404.961981:0:7648:0:(genops.c:885:class_export_put()) final put ffff944a48ee0800/a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:1.0:1787602404.962202:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a48ee0800/a41c7236-f364-42ee-9be0-a289b3ed94f6 for lustre-OST0001 00000020:00000080:1.0:1787602404.962269:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a7c494000 for lustre-OST0001 00000001:02000400:3.0:1787602405.104371:0:9349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.82 00000100:00100000:3.0:1787602405.638145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602405.638215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602405.638249:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821098496 00000100:00100000:0.0:1787602405.638264:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821098496 00000100:00080000:3.0:1787602405.638319:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602405.638359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:0.0:1787602405.638372:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821098496:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602405.638485:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821098496:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 116us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602405.638516:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:1.0:1787602405.638589:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821098368 00000100:00100000:1.0:1787602405.638594:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821098368 00000100:00100000:1.0:1787602405.638629:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 197 00000100:00100000:1.0:1787602405.638635:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2363:x1874436821098368:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602405.638661:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2363:x1874436821098368:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602405.638668:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 197 00010000:00010000:3.0:1787602405.856866:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602406.885822:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787602407.633945:0:9447:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.82 00010000:00010000:3.0:1787602407.905934:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602407.965380:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602407.965411:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838954752:0@lo:400:kworker.0 00000100:00100000:1.0:1787602407.965487:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602407.965547:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838954624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602407.965585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602407.965657:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838955008:0@lo:400:kworker.0 00000100:00100000:1.0:1787602407.965658:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838955264:0@lo:400:kworker.0 00000100:00100000:1.0:1787602407.965710:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602407.965742:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602407.965751:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838955136:0@lo:400:kworker.0 00000100:00100000:2.0:1787602407.965760:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602407.965801:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602407.965809:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787602407.965821:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838954880:0@lo:400:kworker.0 00000100:00100000:1.0:1787602407.965854:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838954624 00000100:00100000:1.0:1787602407.965862:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838954624 00000100:00100000:1.0:1787602407.965921:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787602407.965932:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838954624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602407.965970:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602407.966011:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602407.966076:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838954624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602407.966164:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787602407.966319:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838954752 00000100:00100000:3.0:1787602407.966325:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838954752 00000100:00100000:3.0:1787602407.966359:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787602407.966366:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838954752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602407.966405:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838954752:12345-0@lo:400:kworker.0 Request processed in 39us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602407.966412:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787602407.966551:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838954752:0@lo:400:kworker.0 00000100:00100000:2.0:1787602407.966737:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838955392:0@lo:400:kworker.0 00000100:00100000:2.0:1787602407.966772:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787602407.966821:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602407.966837:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838955136 00000100:00100000:2.0:1787602407.967323:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838955136 00000100:00100000:2.0:1787602407.967390:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838955392 00000100:00100000:2.0:1787602407.967394:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838955392 00000100:00100000:2.0:1787602407.967697:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787602407.967707:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838955136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602407.967792:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838955136:12345-0@lo:400:kworker.0 Request processed in 85us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602407.967799:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787602407.967816:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787602407.967822:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838955392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602407.968081:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838955392:12345-0@lo:400:kworker.0 Request processed in 189us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602407.968107:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787602407.968134:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787602407.968169:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c654380 x1874436838955392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602407.968186:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838955392:0@lo:400:kworker.0 00010000:00080000:0.0:1787602407.968404:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944947d6ad80 x1874436838954624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602407.968444:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838954624:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787602407.968498:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c654e00 x1874436838955136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602407.968508:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838955136:0@lo:400:kworker.0 00000100:00100000:1.0:1787602407.970278:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838955264 00000100:00100000:1.0:1787602407.970291:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838955264 00000100:00100000:1.0:1787602407.970421:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838955008 00000100:00100000:1.0:1787602407.970426:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838955008 00000100:00100000:3.0:1787602407.970585:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838954880 00000100:00100000:3.0:1787602407.970603:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838954880 00000100:00100000:3.0:1787602407.970634:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787602407.970644:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838955264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602407.970673:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787602407.970694:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787602407.970747:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838955264:12345-0@lo:400:kworker.0 Request processed in 102us (5036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602407.970758:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787602407.970785:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787602407.970796:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838954880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602407.970809:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838955264:0@lo:400:kworker.0 00000100:00100000:3.0:1787602407.970842:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838954880:12345-0@lo:400:kworker.0 Request processed in 48us (4831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602407.970850:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787602407.970897:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838954880:0@lo:400:kworker.0 00000100:00080000:0.0:1787602407.973181:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602407.976536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787602407.976551:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436838955008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602407.976645:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436838955008:12345-0@lo:400:kworker.0 Request processed in 98us (10893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602407.976653:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787602407.976696:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838955008:0@lo:400:kworker.0 00010000:00010000:3.0:1787602408.925519:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787602409.182432:0:9496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 16:13:26 EDT 2026 00000100:00100000:1.0:1787602409.503074:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838955520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602409.503172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602409.503307:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838955520 00000100:00100000:2.0:1787602409.503317:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838955520 00000100:00100000:2.0:1787602409.503394:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602409.503406:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838955520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602409.503445:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787602409.503588:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602409.503735:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838955520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 331us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602409.503743:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787602409.503823:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944947d68e00 x1874436838955520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602409.503936:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838955520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787602409.951917:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602410.756766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602410.757622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602410.757680:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821098752 00000100:00100000:2.0:1787602410.757694:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821098752 00000100:00100000:2.0:1787602410.757778:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00100000:2.0:1787602410.757792:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821098752:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602410.758698:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821098752:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 902us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602410.758712:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00080000:2.0:1787602410.758771:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602410.760003:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821098624 00000100:00100000:0.0:1787602410.760018:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821098624 00000100:00100000:0.0:1787602410.760105:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 199 00000100:00100000:0.0:1787602410.760116:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2361:x1874436821098624:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602410.760191:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2361:x1874436821098624:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 76us (3437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602410.760200:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 199 00010000:00010000:3.0:1787602410.973305:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602411.999609:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602413.022061:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602413.087887:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838955904:0@lo:400:kworker.0 00000100:00100000:0.0:1787602413.088065:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838955648:0@lo:400:kworker.0 00000100:00100000:2.0:1787602413.088169:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838955776:0@lo:400:kworker.0 00000100:00100000:3.0:1787602413.088300:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838956032:0@lo:400:kworker.0 00000100:00100000:0.0:1787602413.090286:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602413.090346:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838956160:0@lo:400:kworker.0 00000100:00100000:0.0:1787602413.090396:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602413.090519:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838955648 00000100:00100000:0.0:1787602413.090526:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838955648 00000100:00100000:0.0:1787602413.090784:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787602413.090794:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838955648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602413.090850:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838955648:12345-0@lo:400:kworker.0 Request processed in 57us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602413.090857:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787602413.090985:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838955648:0@lo:400:kworker.0 00000100:00100000:0.0:1787602413.091018:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838956160 00000100:00100000:0.0:1787602413.091022:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838956160 00000100:00100000:0.0:1787602413.091241:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787602413.091248:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838956160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602413.091284:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838956160:12345-0@lo:400:kworker.0 Request processed in 37us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602413.091290:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787602413.091305:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602413.091323:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838956160:0@lo:400:kworker.0 00000100:00100000:1.0:1787602413.097343:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602413.097443:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838956416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602413.097516:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602413.097601:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838956416 00000100:00100000:1.0:1787602413.097612:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838956416 00000100:00100000:1.0:1787602413.097683:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787602413.097693:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838956416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602413.097737:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602413.097790:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838956416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602413.097798:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787602413.098155:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787602413.098203:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944947d68e00 x1874436838956416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602413.098228:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838956416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602413.098440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838955904 00000100:00100000:0.0:1787602413.098447:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838955904 00000100:00100000:0.0:1787602413.098513:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787602413.098530:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838955904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602413.098598:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838955904:12345-0@lo:400:kworker.0 Request processed in 77us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602413.098605:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787602413.105375:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602413.105472:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838955904:0@lo:400:kworker.0 00000100:00100000:2.0:1787602413.109316:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602413.109396:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838956288:0@lo:400:kworker.0 00000100:00100000:2.0:1787602413.109447:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602413.109490:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838956288 00000100:00100000:2.0:1787602413.109499:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838956288 00000100:00100000:1.0:1787602413.109806:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838955776 00000100:00100000:1.0:1787602413.109825:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838955776 00000100:00100000:1.0:1787602413.109877:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787602413.109888:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838955776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602413.110379:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838955776:12345-0@lo:400:kworker.0 Request processed in 490us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602413.110404:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787602413.111329:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787602413.111343:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838956288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602413.111420:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838956288:12345-0@lo:400:kworker.0 Request processed in 82us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602413.111427:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787602413.111487:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6e6b3480 x1874436838956288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602413.111505:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838956288:0@lo:400:kworker.0 00000100:00100000:3.0:1787602413.111761:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602413.113070:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838955776:0@lo:400:kworker.0 00000100:00100000:0.0:1787602413.113242:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838956032 00000100:00100000:0.0:1787602413.113252:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838956032 00000100:00100000:0.0:1787602413.113330:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787602413.113343:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838956032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602413.113441:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838956032:12345-0@lo:400:kworker.0 Request processed in 102us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602413.113449:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787602413.116581:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787602413.123147:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6e6b0700 x1874436838956032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602413.123593:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838956032:0@lo:400:kworker.0 00010000:00010000:3.0:1787602414.045379:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602414.621264:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602414.621301:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838956544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602414.621393:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602414.621569:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838956544 00000100:00100000:1.0:1787602414.621580:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838956544 00000100:00100000:1.0:1787602414.621633:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787602414.621643:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838956544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602414.621686:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602414.621740:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838956544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602414.621748:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787602414.622241:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944947d69c00 x1874436838956544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602414.622264:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838956544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787602415.069348:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602415.881963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602415.882394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602415.882462:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821098880 00000100:00100000:2.0:1787602415.882474:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821098880 00000100:00100000:2.0:1787602415.882873:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 201 00000100:00100000:2.0:1787602415.882886:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2361:x1874436821098880:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602415.882987:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2361:x1874436821098880:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 103us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602415.882996:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 201 00000100:00100000:0.0:1787602415.883339:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821099008 00000100:00100000:0.0:1787602415.883347:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821099008 00000100:00100000:0.0:1787602415.883403:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00100000:0.0:1787602415.883414:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821099008:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602415.883454:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821099008:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 44us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602415.883461:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00080000:3.0:1787602415.883956:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602416.094275:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602417.118203:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602418.149763:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602418.205377:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838956800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602418.205410:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838956928:0@lo:400:kworker.0 00000100:00100000:1.0:1787602418.205482:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602418.205492:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602418.206302:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838956672:0@lo:400:kworker.0 00000100:00100000:0.0:1787602418.206352:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602418.206388:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838957312:0@lo:400:kworker.0 00000100:00100000:2.0:1787602418.207963:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838957056:0@lo:400:kworker.0 00000100:00100000:3.0:1787602418.208063:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838956672 00000100:00100000:2.0:1787602418.208066:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602418.208076:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838956672 00000100:00100000:2.0:1787602418.208122:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787602418.208134:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838957184:0@lo:400:kworker.0 00000100:00100000:3.0:1787602418.208142:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787602418.208156:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838956672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602418.208167:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602418.208199:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838956928 00000100:00100000:2.0:1787602418.208204:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838956928 00000100:00100000:2.0:1787602418.208234:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838957056 00000100:00100000:2.0:1787602418.208237:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838957056 00000100:00100000:2.0:1787602418.208271:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787602418.208280:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838956928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602418.208290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602418.208345:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838956928:12345-0@lo:400:kworker.0 Request processed in 66us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602418.208350:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838957312 00000100:00100000:2.0:1787602418.208354:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787602418.208356:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838957312 00000100:00100000:2.0:1787602418.208378:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787602418.208387:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838957056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602418.208427:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838957056:12345-0@lo:400:kworker.0 Request processed in 42us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602418.208450:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838956672:12345-0@lo:400:kworker.0 Request processed in 296us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602418.208458:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787602418.208827:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787602418.208839:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838957312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602418.208891:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838956672:0@lo:400:kworker.0 00000100:00100000:0.0:1787602418.209185:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838957312:12345-0@lo:400:kworker.0 Request processed in 349us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602418.209192:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787602418.209239:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838956800 00000100:00100000:0.0:1787602418.209245:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838956800 00000100:00100000:3.0:1787602418.209283:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838957312:0@lo:400:kworker.0 00000100:00100000:0.0:1787602418.209309:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787602418.209317:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838956800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787602418.209355:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602418.209406:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838956800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (3931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602418.209412:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787602418.209587:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944947d6b100 x1874436838956800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602418.209605:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838956800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602418.210166:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787602418.210207:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838957184 00000100:00100000:2.0:1787602418.210214:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838957184 00000100:00100000:2.0:1787602418.210256:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787602418.210264:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838957184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602418.210562:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838957184:12345-0@lo:400:kworker.0 Request processed in 298us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602418.210677:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838956928:0@lo:400:kworker.0 00000100:00100000:2.0:1787602418.210830:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787602418.210860:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602418.210877:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787602418.210881:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787602418.210911:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c655180 x1874436838957184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602418.210923:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838957184:0@lo:400:kworker.0 00000100:00100000:2.0:1787602418.210947:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838957056:0@lo:400:kworker.0 00010000:00010000:2.0:1787602419.165354:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602419.741224:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838957440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602419.741319:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602419.745902:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838957440 00000100:00100000:3.0:1787602419.745935:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838957440 00000100:00100000:3.0:1787602419.746248:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787602419.746264:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838957440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602419.746314:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602419.746435:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838957440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (5116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602419.746442:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787602419.746801:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944947d6b100 x1874436838957440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602419.746826:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838957440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787602420.190509:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602420.999833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602420.999900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602420.999980:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821099136 00000100:00100000:3.0:1787602420.999990:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821099136 00000100:00100000:3.0:1787602421.000079:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 203 00000100:00100000:0.0:1787602421.000098:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821099264 00000100:00100000:3.0:1787602421.000105:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2362:x1874436821099136:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602421.000106:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821099264 00000100:00100000:0.0:1787602421.000178:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00100000:3.0:1787602421.000184:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2362:x1874436821099136:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602421.000192:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821099264:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602421.000197:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 203 00000100:00100000:0.0:1787602421.000248:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821099264:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 61us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602421.000257:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00080000:2.0:1787602421.001389:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787602421.215974:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602422.237257:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787602422.618463:0:10127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:13:40 (1787602420) === 00000100:00100000:2.0:1787602423.073770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602423.074025:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821099392 00000100:00100000:0.0:1787602423.074034:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821099392 00000100:00100000:0.0:1787602423.074127:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 204 00000100:00100000:0.0:1787602423.074138:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:8131:x1874436821099392:12345-192.168.206.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787602423.074157:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602423.074177:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5890c600/0x576b7af90af4690b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fc99 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602423.074205:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890c600/0x576b7af90af4690b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc99 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602423.074218:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5890c600/0x576b7af90af4690b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc99 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602423.074248:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890c600, rc 0) 00000100:00100000:0.0:1787602423.074317:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:8131:x1874436821099392:12345-192.168.206.25@tcp:101:mount.lustre.0 Request processed in 171us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602423.074324:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 204 00000100:00100000:3.0:1787602423.078740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602423.079618:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821099520 00000100:00100000:1.0:1787602423.079629:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821099520 00000100:00100000:1.0:1787602423.079695:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 205 00000100:00100000:1.0:1787602423.079705:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:8131:x1874436821099520:12345-192.168.206.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787602423.080707:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:8131:x1874436821099520:12345-192.168.206.25@tcp:501:mount.lustre.0 Request processed in 999us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602423.080718:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 205 00000100:00100000:2.0:1787602423.094668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602423.094845:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821099648 00000100:00100000:3.0:1787602423.094855:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821099648 00000100:00100000:3.0:1787602423.094933:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 206 00000100:00100000:3.0:1787602423.094954:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:8131:x1874436821099648:12345-192.168.206.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787602423.095228:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:8131:x1874436821099648:12345-192.168.206.25@tcp:503:mount.lustre.0 Request processed in 285us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602423.095247:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 206 00000100:00100000:2.0:1787602423.102953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602423.103064:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821099776 00000100:00100000:0.0:1787602423.103073:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821099776 00000100:00100000:0.0:1787602423.103124:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 207 00000100:00100000:0.0:1787602423.103133:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:8135:x1874436821099776:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602423.103452:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:8135:x1874436821099776:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 319us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602423.103461:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 207 00000100:00100000:0.0:1787602423.146980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602423.147225:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821099904 00000100:00100000:1.0:1787602423.147235:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821099904 00000100:00100000:1.0:1787602423.147290:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 208 00000100:00100000:1.0:1787602423.147301:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:8135:x1874436821099904:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787602423.147653:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:8135:x1874436821099904:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 353us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602423.147662:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 208 00000100:00100000:2.0:1787602423.157338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602423.163111:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821100032 00000100:00100000:3.0:1787602423.163232:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821100032 00000100:00100000:3.0:1787602423.163375:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 209 00000100:00100000:3.0:1787602423.163387:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:8131:x1874436821100032:12345-192.168.206.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787602423.163405:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602423.163424:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d71800/0x576b7af90af46912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fcc3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602423.163453:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71800/0x576b7af90af46912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcc3 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602423.163475:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d71800/0x576b7af90af46912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcc3 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602423.163485:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71800, rc 0) 00000100:00100000:3.0:1787602423.163565:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:8131:x1874436821100032:12345-192.168.206.25@tcp:101:mount.lustre.0 Request processed in 180us (6234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602423.163572:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 209 00000100:00100000:2.0:1787602423.167661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602423.167754:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821100160 00000100:00100000:0.0:1787602423.167772:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821100160 00000100:00100000:0.0:1787602423.167877:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 210 00000100:00100000:0.0:1787602423.167889:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:8131:x1874436821100160:12345-192.168.206.25@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787602423.167924:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787602423.167946:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787602423.167950:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787602423.167954:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787602423.167956:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787602423.171710:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:8131:x1874436821100160:12345-192.168.206.25@tcp:256:mount.lustre.0 Request processed in 3813us (4047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602423.171725:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 210 00000100:00100000:2.0:1787602423.178985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602423.179166:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821100288 00000100:00100000:3.0:1787602423.179185:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821100288 00000100:00100000:3.0:1787602423.179265:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 211 00000100:00100000:3.0:1787602423.179279:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:8131:x1874436821100288:12345-192.168.206.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787602423.179310:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602423.179333:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70c00/0x576b7af90af46919 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fcca expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602423.179400:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70c00/0x576b7af90af46919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcca expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602423.179413:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70c00/0x576b7af90af46919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcca expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602423.179423:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70c00, rc 0) 00000100:00100000:3.0:1787602423.179513:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:8131:x1874436821100288:12345-192.168.206.25@tcp:101:mount.lustre.0 Request processed in 236us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602423.179520:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 211 00000100:00100000:3.0:1787602423.181986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602423.182207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821100416 00000100:00100000:2.0:1787602423.182219:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821100416 00000100:00100000:2.0:1787602423.182566:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 212 00000100:00100000:2.0:1787602423.182582:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:8131:x1874436821100416:12345-192.168.206.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787602423.182981:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:8131:x1874436821100416:12345-192.168.206.25@tcp:501:mount.lustre.0 Request processed in 402us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602423.184937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 212 00000100:00100000:0.0:1787602423.194961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602423.195809:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821100544 00000100:00100000:3.0:1787602423.195823:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821100544 00000100:00100000:0.0:1787602423.196083:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 213 00000100:00100000:0.0:1787602423.196097:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:8131:x1874436821100544:12345-192.168.206.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787602423.197662:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:8131:x1874436821100544:12345-192.168.206.25@tcp:503:mount.lustre.0 Request processed in 1558us (2703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602423.197674:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 213 00000100:00100000:3.0:1787602423.201814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602423.202182:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821100672 00000100:00100000:2.0:1787602423.202195:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821100672 00000100:00100000:2.0:1787602423.202262:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 214 00000100:00100000:2.0:1787602423.202273:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:8140:x1874436821100672:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787602423.202752:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:8140:x1874436821100672:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 478us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602423.202771:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 214 00000100:00100000:3.0:1787602423.205844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602423.206202:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821100800 00000100:00100000:0.0:1787602423.206216:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821100800 00000100:00100000:0.0:1787602423.206281:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 215 00000100:00100000:0.0:1787602423.206294:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:8140:x1874436821100800:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602423.206848:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:8140:x1874436821100800:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 554us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602423.206858:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 215 00000100:00100000:0.0:1787602423.210149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602423.210587:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821101056 00000100:00100000:2.0:1787602423.210601:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821101056 00000100:00100000:2.0:1787602423.210739:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00100000:2.0:1787602423.210752:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821101056:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602423.210859:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821101056:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 110us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602423.210868:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00080000:3.0:1787602423.214725:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602423.215103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602423.215370:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821100928 00000100:00100000:1.0:1787602423.215383:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821100928 00000100:00100000:1.0:1787602423.215432:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:1.0:1787602423.215442:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1874436821100928:12345-192.168.206.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787602423.215481:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3ebc1a79-d388-4b93-8c58-223a06e0bf6b@192.168.206.25@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:1.0:1787602423.215523:0:5833:0:(genops.c:1385:class_connect()) connect: client 3ebc1a79-d388-4b93-8c58-223a06e0bf6b, cookie 0x576b7af90af46920 00000004:00100000:1.0:1787602423.215556:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787602423.215851:0:5833:0:(import.c:65:import_set_state_nolock()) ffff944a7c47d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602423.215944:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2360:x1874436821100928:12345-192.168.206.25@tcp:38:mount.lustre.0 Request processed in 502us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602423.215952:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:1.0:1787602423.218538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602423.218635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602423.219134:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821101184 00000100:00100000:2.0:1787602423.219146:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821101184 00000100:00100000:0.0:1787602423.219208:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821101312 00000100:00100000:0.0:1787602423.219214:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821101312 00000100:00100000:2.0:1787602423.219245:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:0.0:1787602423.219256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00100000:2.0:1787602423.219263:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+7:0:x1874436821101184:12345-192.168.206.25@tcp:41:mount.lustre.0 00000100:00100000:0.0:1787602423.219272:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+7:8131:x1874436821101312:12345-192.168.206.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787602423.219399:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1787602423.219491:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602423.219510:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+7:8131:x1874436821101312:12345-192.168.206.25@tcp:41:mount.lustre.0 Request processed in 240us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602423.219519:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 12 00000004:00000024:2.0:1787602423.223433:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787602423.223870:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:0:x1874436821101184:12345-192.168.206.25@tcp:41:mount.lustre.0 Request processed in 4607us (5335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602423.223884:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:1.0:1787602423.230802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602423.230966:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821101440 00000100:00100000:0.0:1787602423.230978:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821101440 00000100:00100000:0.0:1787602423.231088:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:0.0:1787602423.231103:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:8131:x1874436821101440:12345-192.168.206.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787602423.231863:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:8131:x1874436821101440:12345-192.168.206.25@tcp:40:mount.lustre.0 Request processed in 758us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602423.231892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:3.0:1787602423.236210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602423.236386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602423.236557:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602423.236790:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821101824 00000100:00100000:2.0:1787602423.236821:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821101824 00000100:00100000:2.0:1787602423.236886:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:2.0:1787602423.236911:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:8131:x1874436821101824:12345-192.168.206.25@tcp:33:mount.lustre.0 00000100:00100000:1.0:1787602423.237457:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821101568 00000100:00100000:1.0:1787602423.237465:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821101568 00000100:00100000:1.0:1787602423.237522:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821101696 00000100:00100000:1.0:1787602423.237526:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821101696 00000100:00100000:1.0:1787602423.237563:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00100000:1.0:1787602423.237571:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1874436821101568:12345-192.168.206.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787602423.237606:0:8475:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3ebc1a79-d388-4b93-8c58-223a06e0bf6b@192.168.206.25@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:1.0:1787602423.237641:0:8475:0:(genops.c:1385:class_connect()) connect: client 3ebc1a79-d388-4b93-8c58-223a06e0bf6b, cookie 0x576b7af90af46927 00002000:00100000:1.0:1787602423.237662:0:8475:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ebc1a79-d388-4b93-8c58-223a06e0bf6b/ffff944a7c47a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602423.237690:0:8475:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602423.237943:0:8475:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787602423.237975:0:8475:0:(import.c:65:import_set_state_nolock()) ffff944a7c479800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602423.238078:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2360:x1874436821101568:12345-192.168.206.25@tcp:8:mount.lustre.0 Request processed in 505us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602423.238087:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00100000:1.0:1787602423.238108:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:1.0:1787602423.238113:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1874436821101696:12345-192.168.206.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787602423.238130:0:8475:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3ebc1a79-d388-4b93-8c58-223a06e0bf6b@192.168.206.25@tcp t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:1.0:1787602423.238146:0:8475:0:(genops.c:1385:class_connect()) connect: client 3ebc1a79-d388-4b93-8c58-223a06e0bf6b, cookie 0x576b7af90af4692e 00002000:00100000:1.0:1787602423.238152:0:8475:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ebc1a79-d388-4b93-8c58-223a06e0bf6b/ffff944a7c47f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602423.238167:0:8475:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00200000:2.0:1787602423.240511:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787602423.240790:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:8131:x1874436821101824:12345-192.168.206.25@tcp:33:mount.lustre.0 Request processed in 3886us (4589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602423.240802:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 1 00002000:00080000:1.0:1787602423.242526:0:8475:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787602423.242580:0:8475:0:(import.c:65:import_set_state_nolock()) ffff944a7c47c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602423.242952:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2360:x1874436821101696:12345-192.168.206.25@tcp:8:mount.lustre.0 Request processed in 4832us (6391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602423.242965:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 13 00010000:00010000:3.0:1787602423.261275:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602423.325303:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838957568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602423.325361:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838957696:0@lo:400:kworker.0 00000100:00100000:2.0:1787602423.325421:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602423.325471:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602423.325524:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838958080:0@lo:400:kworker.0 00000100:00100000:2.0:1787602423.325571:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602423.325623:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838957568 00000100:00100000:2.0:1787602423.325631:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838957568 00000100:00100000:2.0:1787602423.325699:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787602423.325709:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838957568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602423.325734:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602423.325792:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c655180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838957568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602423.325801:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787602423.325830:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838958080 00000100:00100000:2.0:1787602423.325834:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838958080 00000100:00100000:2.0:1787602423.325864:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787602423.325871:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838958080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602423.325920:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838958080:12345-0@lo:400:kworker.0 Request processed in 49us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602423.325928:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787602423.325987:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6e48d500 x1874436838958080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602423.326004:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838958080:0@lo:400:kworker.0 00010000:00080000:2.0:1787602423.326015:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ebc5500 x1874436838957568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602423.326028:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838957568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602423.326090:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838957696 00000100:00100000:2.0:1787602423.326094:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838957696 00000100:00100000:2.0:1787602423.326122:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787602423.326129:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838957696:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787602423.330447:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602423.330457:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602423.330481:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436838957952:0@lo:400:kworker.0 00000100:00100000:0.0:1787602423.330572:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602423.330627:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787602423.330635:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838957824:0@lo:400:kworker.0 00000100:00100000:0.0:1787602423.330660:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602423.330699:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838957952 00000100:00100000:0.0:1787602423.330708:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838957952 00000100:00100000:0.0:1787602423.330768:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838957824 00000100:00100000:0.0:1787602423.330772:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838957824 00000100:00100000:0.0:1787602423.330811:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787602423.330823:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436838957952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602423.330888:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436838957952:12345-0@lo:400:kworker.0 Request processed in 67us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602423.330909:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787602423.330928:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838958208:0@lo:400:kworker.0 00000100:00100000:0.0:1787602423.330930:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787602423.330942:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838957824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602423.330985:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838957824:12345-0@lo:400:kworker.0 Request processed in 44us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602423.330992:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787602423.334016:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838957824:0@lo:400:kworker.0 00000100:00100000:0.0:1787602423.334055:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436838957952:0@lo:400:kworker.0 00000100:00080000:0.0:1787602423.334107:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602423.334261:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602423.335762:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838957696:12345-0@lo:400:kworker.0 Request processed in 9621us (10281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602423.335780:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787602423.336637:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838957696:0@lo:400:kworker.0 00000100:00100000:0.0:1787602423.338144:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838958208 00000100:00100000:0.0:1787602423.338157:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838958208 00000100:00100000:1.0:1787602423.338462:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787602423.338489:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838958208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602423.338587:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838958208:12345-0@lo:400:kworker.0 Request processed in 102us (4332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602423.338594:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787602423.338738:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602423.339115:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838958208:0@lo:400:kworker.0 00010000:00010000:3.0:1787602424.286456:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602424.863991:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838958336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602424.864244:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602424.864764:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838958336 00000100:00100000:1.0:1787602424.864773:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838958336 00000100:00100000:1.0:1787602424.864869:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787602424.864880:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838958336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602424.864916:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602424.864969:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838958336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602424.864977:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787602424.868504:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c484000 x1874436838958336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602424.868532:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838958336:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787602424.926546:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ebc1a79-d388-4b93-8c58-223a06e0bf6b 00010000:00010000:2.0:1787602425.315624:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787602425.418294:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ebc1a79-d388-4b93-8c58-223a06e0bf6b 00010000:00010000:3.0:1787602426.333353:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602427.359758:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787602428.024583:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ebc1a79-d388-4b93-8c58-223a06e0bf6b 00000001:02000400:0.0:1787602428.294832:0:10325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787602428.381989:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602428.445297:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838958592:0@lo:400:kworker.0 00000100:00100000:0.0:1787602428.445389:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602428.445450:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838959104:0@lo:400:kworker.0 00000100:00100000:0.0:1787602428.445477:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602428.445510:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602428.445529:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838958720:0@lo:400:kworker.0 00000100:00100000:0.0:1787602428.445553:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602428.445587:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838958592 00000100:00100000:0.0:1787602428.445596:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838958592 00000100:00100000:0.0:1787602428.445648:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838958720 00000100:00100000:0.0:1787602428.445652:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838958720 00000100:00100000:0.0:1787602428.445682:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787602428.445691:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838958592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602428.445749:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838958592:12345-0@lo:400:kworker.0 Request processed in 58us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602428.445756:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787602428.445776:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787602428.445783:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838958720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602428.445809:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838958720:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602428.445828:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787602428.445849:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838959104 00000100:00100000:0.0:1787602428.445852:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838959104 00000100:00100000:0.0:1787602428.446184:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787602428.446192:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838959104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602428.446233:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838959104:12345-0@lo:400:kworker.0 Request processed in 43us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602428.446240:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787602428.446265:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602428.446269:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602428.446308:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838958720:0@lo:400:kworker.0 00000100:00100000:0.0:1787602428.446318:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838958592:0@lo:400:kworker.0 00010000:00080000:0.0:1787602428.446330:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ef94700 x1874436838959104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602428.446341:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838959104:0@lo:400:kworker.0 00000100:00100000:1.0:1787602428.446697:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838958464:0@lo:400:kworker.0 00000100:00100000:1.0:1787602428.446743:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602428.446772:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838958976:0@lo:400:kworker.0 00000100:00100000:1.0:1787602428.446796:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602428.446814:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602428.446820:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838958848:0@lo:400:kworker.0 00000100:00100000:1.0:1787602428.446841:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602428.446886:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838958848 00000100:00100000:1.0:1787602428.446891:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838958848 00000100:00100000:1.0:1787602428.446930:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787602428.446938:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838958848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602428.446987:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838958848:12345-0@lo:400:kworker.0 Request processed in 51us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602428.446994:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787602428.447025:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6e48d500 x1874436838958848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602428.447058:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838958848:0@lo:400:kworker.0 00000100:00100000:0.0:1787602428.447249:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838958464 00000100:00100000:0.0:1787602428.447254:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838958464 00000100:00100000:0.0:1787602428.447280:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787602428.447287:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838958464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602428.447339:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838958464:12345-0@lo:400:kworker.0 Request processed in 47us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602428.447346:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:0.0:1787602428.447375:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602428.447386:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838958976 00000100:00100000:0.0:1787602428.447390:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838958976 00000100:00100000:0.0:1787602428.447428:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787602428.447435:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838958976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602428.447466:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838958976:12345-0@lo:400:kworker.0 Request processed in 32us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602428.447471:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787602428.447487:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602428.447551:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838958464:0@lo:400:kworker.0 00000100:00100000:3.0:1787602428.447573:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838958976:0@lo:400:kworker.0 00000100:00100000:3.0:1787602428.451077:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602428.451105:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838959232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602428.451191:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602428.451255:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838959232 00000100:00100000:3.0:1787602428.451264:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838959232 00000100:00100000:3.0:1787602428.451324:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787602428.451335:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838959232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602428.451378:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602428.451429:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838959232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602428.451436:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787602428.451485:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ebc4000 x1874436838959232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602428.451505:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838959232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602428.675499:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602428.675554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602428.675584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602428.675605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602428.675625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602428.675654:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821102464 00000100:00100000:0.0:1787602428.675665:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821102464 00000100:00100000:0.0:1787602428.675734:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821102336 00000100:00100000:0.0:1787602428.675737:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821102336 00000100:00100000:0.0:1787602428.675759:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 32 00000100:00100000:0.0:1787602428.675769:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821102464:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602428.675845:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821102464:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 78us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602428.675853:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 32 00000100:00100000:0.0:1787602428.675880:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:0.0:1787602428.675887:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821102336:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602428.675910:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821102336:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 24us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602428.675915:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:0.0:1787602428.675934:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821102208 00000100:00100000:0.0:1787602428.675953:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821102208 00000100:00100000:0.0:1787602428.675984:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821102080 00000100:00100000:0.0:1787602428.675987:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821102080 00000100:00100000:0.0:1787602428.676006:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 59 00000100:00100000:0.0:1787602428.676011:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821102208:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602428.676097:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821102208:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 85us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602428.676104:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 59 00000100:00100000:0.0:1787602428.676116:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 60 00000100:00100000:0.0:1787602428.676122:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821102080:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602428.676147:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821102080:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 25us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602428.676153:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 60 00000100:00080000:0.0:1787602428.676175:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787602428.676180:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602428.676182:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602428.676818:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821101952 00000100:00100000:3.0:1787602428.676828:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821101952 00000100:00100000:3.0:1787602428.676884:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 218 00000100:00100000:3.0:1787602428.676893:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2364:x1874436821101952:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602428.676949:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2364:x1874436821101952:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 57us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602428.676956:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 218 00010000:00010000:1.0:1787602429.405131:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602429.984838:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787602429.984878:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838959360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602429.984966:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602429.985058:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838959360 00000100:00100000:2.0:1787602429.985077:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838959360 00000100:00100000:2.0:1787602429.985130:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787602429.985140:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838959360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602429.985182:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602429.985231:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838959360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602429.985259:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1787602429.985309:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c654e00 x1874436838959360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602429.985332:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838959360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787602430.429829:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602431.457455:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602432.478453:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602433.502261:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602433.565873:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838959488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602433.565940:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602433.567341:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838959744:0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.567422:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602433.567461:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787602433.567468:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838959616:0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.567498:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602433.567608:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838960128:0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.567632:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602433.567792:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838959744 00000100:00100000:3.0:1787602433.567801:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838959744 00000100:00100000:3.0:1787602433.567959:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838960128 00000100:00100000:3.0:1787602433.567963:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838960128 00000100:00100000:3.0:1787602433.568005:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787602433.568019:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838959744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.568115:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838959744:12345-0@lo:400:kworker.0 Request processed in 101us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602433.568123:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787602433.568145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787602433.568152:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838960128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.568179:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838960128:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602433.568185:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787602433.568255:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838959488 00000100:00100000:1.0:1787602433.568269:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838959488 00000100:00100000:3.0:1787602433.568272:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838959616 00000100:00100000:3.0:1787602433.568279:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838959616 00000100:00100000:3.0:1787602433.568319:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787602433.568327:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838959616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602433.568341:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787602433.568362:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838959488:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602433.568370:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838959616:12345-0@lo:400:kworker.0 Request processed in 41us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602433.568392:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00002000:00000024:1.0:1787602433.568409:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787602433.568437:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602433.568444:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602433.568460:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838959872:0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.568490:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602433.568561:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838959488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 206us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602433.568569:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787602433.568598:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602433.568611:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838960000:0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.568647:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602433.568814:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838960000 00000100:00100000:3.0:1787602433.568819:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838960000 00000100:00100000:3.0:1787602433.568944:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787602433.568955:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838960000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.569008:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838960000:12345-0@lo:400:kworker.0 Request processed in 57us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602433.569021:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787602433.569075:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787602433.569114:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ebc4000 x1874436838959488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602433.569140:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838959488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602433.569183:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838959616:0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.569198:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838960128:0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.569220:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838959744:0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.569244:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838959872 00000100:00100000:3.0:1787602433.569248:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838959872 00000100:00100000:3.0:1787602433.569298:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787602433.569306:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838959872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602433.569344:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838959872:12345-0@lo:400:kworker.0 Request processed in 38us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602433.569353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787602433.569381:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787602433.569402:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7512ce00 x1874436838960000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602433.569419:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838960000:0@lo:400:kworker.0 00000100:00100000:0.0:1787602433.569433:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838959872:0@lo:400:kworker.0 00000100:00100000:0.0:1787602433.799015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602433.799086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602433.799147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602433.799172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602433.799197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602433.799230:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821103104 00000100:00100000:0.0:1787602433.799240:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821103104 00000100:00100000:0.0:1787602433.799302:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821102976 00000100:00100000:0.0:1787602433.799305:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821102976 00000100:00100000:0.0:1787602433.799331:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:0.0:1787602433.799340:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2363:x1874436821103104:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602433.799431:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2363:x1874436821103104:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 91us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602433.799439:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:0.0:1787602433.799460:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00100000:0.0:1787602433.799467:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2363:x1874436821102976:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602433.799493:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2363:x1874436821102976:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602433.799499:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00100000:2.0:1787602433.800593:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821102592 00000100:00100000:2.0:1787602433.800603:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821102592 00000100:00100000:2.0:1787602433.800648:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 220 00000100:00100000:2.0:1787602433.800657:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821102592:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602433.800710:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821102592:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 55us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602433.800717:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 220 00000100:00100000:3.0:1787602433.801380:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821102848 00000100:00100000:3.0:1787602433.801387:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821102848 00000100:00100000:3.0:1787602433.801488:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821102720 00000100:00100000:3.0:1787602433.801492:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821102720 00000100:00100000:3.0:1787602433.801520:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 64 00000100:00100000:3.0:1787602433.801527:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2363:x1874436821102848:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602433.801579:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2363:x1874436821102848:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 52us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602433.801586:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 64 00000100:00100000:3.0:1787602433.801600:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 65 00000100:00100000:3.0:1787602433.801606:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821102720:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602433.801628:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821102720:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 23us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602433.801634:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 65 00000100:00080000:3.0:1787602433.801654:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787602433.801659:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602433.801662:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787602434.525433:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602435.103397:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787602435.103419:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838960256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602435.103507:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602435.103985:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838960256 00000100:00100000:1.0:1787602435.103994:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838960256 00000100:00100000:1.0:1787602435.104070:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787602435.104081:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838960256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602435.104119:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602435.104174:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838960256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602435.104182:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787602435.104222:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787602435.104254:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c654e00 x1874436838960256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602435.104282:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838960256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602435.550734:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602436.573267:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602437.602004:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602438.622113:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602438.686246:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838960384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602438.686329:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602438.686438:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838960384 00000100:00100000:1.0:1787602438.686447:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838960384 00000100:00100000:1.0:1787602438.686504:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787602438.686515:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838960384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602438.686550:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602438.686599:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838960384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602438.686606:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787602438.686648:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7512fb80 x1874436838960384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602438.686667:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838960384:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787602438.686876:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602438.687153:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838960512:0@lo:400:kworker.0 00000100:00100000:3.0:1787602438.687189:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602438.687220:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838961024:0@lo:400:kworker.0 00000100:00100000:3.0:1787602438.687269:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602438.687288:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602438.687293:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838960896:0@lo:400:kworker.0 00000100:00100000:3.0:1787602438.687314:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602438.687338:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838961024 00000100:00100000:3.0:1787602438.687343:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838961024 00000100:00100000:3.0:1787602438.687378:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787602438.687386:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838961024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602438.687421:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838961024:12345-0@lo:400:kworker.0 Request processed in 36us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602438.687428:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787602438.687447:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838960896 00000100:00100000:3.0:1787602438.687451:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838960896 00000100:00100000:3.0:1787602438.687475:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787602438.687481:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838960896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602438.687509:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838960896:12345-0@lo:400:kworker.0 Request processed in 28us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602438.687515:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787602438.687534:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602438.687538:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787602438.687556:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c62e300 x1874436838960896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602438.687581:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838960896:0@lo:400:kworker.0 00000100:00100000:3.0:1787602438.687594:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838961024:0@lo:400:kworker.0 00000100:00100000:1.0:1787602438.687715:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838960640:0@lo:400:kworker.0 00000100:00100000:1.0:1787602438.687763:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602438.687791:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602438.687797:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838960768:0@lo:400:kworker.0 00000100:00100000:1.0:1787602438.687831:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602438.687863:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838960640 00000100:00100000:1.0:1787602438.687867:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838960640 00000100:00100000:1.0:1787602438.687890:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838960768 00000100:00100000:1.0:1787602438.687893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838960768 00000100:00100000:1.0:1787602438.687912:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787602438.687919:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838960640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602438.687954:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838960640:12345-0@lo:400:kworker.0 Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602438.687968:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787602438.687983:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787602438.687989:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838960768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602438.688020:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838960768:12345-0@lo:400:kworker.0 Request processed in 32us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602438.688026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787602438.688062:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602438.688081:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838960768:0@lo:400:kworker.0 00000100:00100000:1.0:1787602438.688090:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838960640:0@lo:400:kworker.0 00000100:00100000:0.0:1787602438.688362:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838960512 00000100:00100000:0.0:1787602438.688367:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838960512 00000100:00100000:0.0:1787602438.688394:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787602438.688402:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838960512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602438.688449:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838960512:12345-0@lo:400:kworker.0 Request processed in 49us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602438.688456:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787602438.688561:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838960512:0@lo:400:kworker.0 00000100:00100000:0.0:1787602438.922313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602438.922365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602438.922395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602438.922415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602438.922543:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821103232 00000100:00100000:3.0:1787602438.922553:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821103232 00000100:00100000:0.0:1787602438.922594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602438.922613:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 222 00000100:00100000:3.0:1787602438.922626:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821103232:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602438.922629:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821103488 00000100:00100000:0.0:1787602438.922635:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821103488 00000100:00100000:0.0:1787602438.922682:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821103360 00000100:00100000:3.0:1787602438.922700:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821103232:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 77us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602438.922707:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 222 00000100:00100000:3.0:1787602438.922739:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821103744 00000100:00100000:3.0:1787602438.922742:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821103744 00000100:00100000:3.0:1787602438.922767:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821103616 00000100:00100000:3.0:1787602438.922770:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821103616 00000100:00100000:3.0:1787602438.922790:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 38 00000100:00100000:3.0:1787602438.922796:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821103744:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602438.922840:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821103360 00000100:00100000:3.0:1787602438.922842:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821103744:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 45us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602438.922850:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 38 00000100:00100000:3.0:1787602438.922865:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:3.0:1787602438.922872:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821103616:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602438.922879:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 69 00000100:00100000:0.0:1787602438.922891:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821103488:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602438.922899:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821103616:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602438.922906:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:0.0:1787602438.922934:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821103488:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 46us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602438.922942:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 69 00000100:00100000:0.0:1787602438.922959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 70 00000100:00100000:0.0:1787602438.922967:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821103360:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602438.923140:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821103360:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 172us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602438.923147:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 70 00000100:00080000:0.0:1787602438.923172:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602438.923175:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602438.923178:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787602439.645372:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602440.221255:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602440.221285:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838961152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602440.221367:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602440.221444:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838961152 00000100:00100000:1.0:1787602440.221458:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838961152 00000100:00100000:1.0:1787602440.221620:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787602440.221639:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838961152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602440.222504:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602440.222606:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838961152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 972us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602440.222616:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787602440.224139:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c485c00 x1874436838961152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602440.224172:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838961152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787602440.225341:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787602440.669255:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602441.693459:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602442.723265:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787602442.887936:0:11024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787602443.752345:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602443.805612:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838961664:0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.805797:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838961408:0@lo:400:kworker.0 00000100:00100000:0.0:1787602443.805840:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838961280:0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.809286:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602443.809761:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838961920:0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.809810:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602443.809846:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787602443.809853:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838961536:0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.809877:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602443.809900:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838962048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602443.809921:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602443.809952:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838961408 00000100:00100000:3.0:1787602443.809959:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838961408 00000100:00100000:3.0:1787602443.810000:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838961536 00000100:00100000:3.0:1787602443.810003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838961536 00000100:00100000:3.0:1787602443.810033:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787602443.810070:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838961408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.810119:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838961408:12345-0@lo:400:kworker.0 Request processed in 50us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602443.810126:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787602443.810142:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787602443.810148:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838961536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.810175:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838961536:12345-0@lo:400:kworker.0 Request processed in 27us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602443.810181:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787602443.810199:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838961920 00000100:00100000:3.0:1787602443.810213:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838961920 00000100:00100000:3.0:1787602443.810238:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787602443.810244:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838961920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.810273:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838961920:12345-0@lo:400:kworker.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602443.810279:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787602443.810297:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838962048 00000100:00100000:3.0:1787602443.810300:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838962048 00000100:00100000:0.0:1787602443.810564:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602443.810592:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838961792:0@lo:400:kworker.0 00000100:00100000:0.0:1787602443.810616:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602443.812840:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787602443.812856:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838962048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602443.812891:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602443.812961:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838962048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602443.812968:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787602443.812999:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838961792 00000100:00100000:3.0:1787602443.813007:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838961792 00000100:00100000:3.0:1787602443.813051:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787602443.813059:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838961792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.813614:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838961792:12345-0@lo:400:kworker.0 Request processed in 554us (2993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602443.813621:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787602443.813720:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602443.813726:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602443.813748:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838961280 00000100:00100000:3.0:1787602443.813753:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838961280 00000100:00100000:3.0:1787602443.813782:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787602443.813800:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838961280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.813840:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838961280:12345-0@lo:400:kworker.0 Request processed in 41us (3276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602443.813858:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787602443.813919:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838961536:0@lo:400:kworker.0 00010000:00080000:3.0:1787602443.813935:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7512f100 x1874436838962048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602443.813950:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838962048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602443.813962:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838961408:0@lo:400:kworker.0 00010000:00080000:3.0:1787602443.813971:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ea48700 x1874436838961920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602443.813978:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838961920:0@lo:400:kworker.0 00000100:00100000:1.0:1787602443.814238:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602443.814402:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838961280:0@lo:400:kworker.0 00000100:00100000:0.0:1787602443.814416:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838961792:0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.814579:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838961664 00000100:00100000:3.0:1787602443.814584:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838961664 00000100:00100000:3.0:1787602443.814682:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787602443.814690:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838961664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602443.814733:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838961664:12345-0@lo:400:kworker.0 Request processed in 44us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602443.814739:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787602443.814877:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c654e00 x1874436838961664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602443.814888:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838961664:0@lo:400:kworker.0 00000100:00080000:0.0:1787602443.818801:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602444.036688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602444.036740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602444.036775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602444.036824:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821104128 00000100:00100000:0.0:1787602444.036831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602444.036839:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821104128 00000100:00100000:0.0:1787602444.036870:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602444.036919:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821104000 00000100:00100000:1.0:1787602444.036923:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821104000 00000100:00100000:2.0:1787602444.036959:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821103872 00000100:00100000:2.0:1787602444.036974:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821103872 00000100:00100000:2.0:1787602444.037023:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 224 00000100:00100000:2.0:1787602444.037055:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2362:x1874436821103872:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602444.037139:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2362:x1874436821103872:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 106us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602444.037147:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 224 00000100:00100000:0.0:1787602444.038624:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 74 00000100:00100000:0.0:1787602444.038647:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2362:x1874436821104128:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602444.038738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 75 00000100:00100000:2.0:1787602444.038773:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821104000:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602444.038827:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821104000:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 60us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602444.038866:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2362:x1874436821104128:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 229us (2125us total) trans 0 rc 0/0 00000100:00080000:1.0:1787602444.038873:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602444.038876:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 74 00000100:00100000:1.0:1787602444.038923:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821104256 00000100:00100000:1.0:1787602444.038934:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821104256 00000100:00100000:1.0:1787602444.038993:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821104384 00000100:00100000:1.0:1787602444.038997:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821104384 00000100:00100000:1.0:1787602444.039031:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00100000:1.0:1787602444.039076:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ecda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2360:x1874436821104256:12345-192.168.206.25@tcp:9:kworker.0 00000020:00000080:1.0:1787602444.039166:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46927 00000100:00080000:1.0:1787602444.039176:0:6692:0:(import.c:65:import_set_state_nolock()) ffff944a7c479800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787602444.039230:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787602444.039388:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:0.0:1787602444.039401:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2360:x1874436821104384:12345-192.168.206.25@tcp:9:kworker.0 00000020:00000080:0.0:1787602444.039421:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af4692e 00000100:00080000:0.0:1787602444.039433:0:6693:0:(import.c:65:import_set_state_nolock()) ffff944a7c47c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787602444.039472:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787602444.040183:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ecda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+2:2360:x1874436821104256:12345-192.168.206.25@tcp:9:kworker.0 Request processed in 1104us (3351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602444.040193:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 14 00010000:00010000:1.0:1787602444.040352:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602444.042157:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787602444.042208:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602444.042214:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602444.042689:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 75 00000100:00100000:0.0:1787602444.046209:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+2:2360:x1874436821104384:12345-192.168.206.25@tcp:9:kworker.0 Request processed in 6792us (9320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602444.046249:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 15 00010000:00010000:3.0:1787602444.767630:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602445.342355:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602445.342377:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838962176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602445.342448:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602445.342587:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838962176 00000100:00100000:2.0:1787602445.342595:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838962176 00000100:00080000:3.0:1787602445.342708:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602445.342765:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787602445.342785:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838962176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602445.342820:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602445.343199:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838962176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 424us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602445.343208:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787602445.344623:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a751b1500 x1874436838962176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602445.344705:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838962176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787602445.790130:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787602445.797843:0:11171:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3214b430 20000000:00000080:0.0:1787602445.797861:0:11171:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff944a6e546400 uarg=0000000000000000 20000000:01000000:0.0:1787602445.797895:0:11171:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787602445.797902:0:11171:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787602445.797906:0:11171:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787602445.798851:0:11172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787602445.799009:0:11171:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787602445.805162:0:11171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787602445.805193:0:11171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805213:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41486400/0x576b7af90af468e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af468da expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805221:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a5890ca00/0x576b7af90af468ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af468e8 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805228:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41477e00/0x576b7af90af468fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af468f6 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805237:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41476400/0x576b7af90af46904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc92 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805244:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a47d70c00/0x576b7af90af46919 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcca expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805251:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805298:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a47d70c00/0x576b7af90af46919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcca expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805327:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a47d70c00/0x576b7af90af46919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcca expref: 12 pid: 5827 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602445.805341:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874436838962304:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602445.805500:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41476400/0x576b7af90af46904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc92 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805508:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a41476400/0x576b7af90af46904 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc92 expref: 12 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602445.805516:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874436838962432:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602445.805547:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41477e00/0x576b7af90af468fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af468f6 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805555:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41477e00/0x576b7af90af468fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af468f6 expref: 18 pid: 5826 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602445.805564:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874436838962560:0@lo:104: 00000100:00100000:0.0:1787602445.805600:0:11171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602445.805713:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a5890ca00/0x576b7af90af468ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af468e8 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805721:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a5890ca00/0x576b7af90af468ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af468e8 expref: 18 pid: 5828 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602445.805729:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874436838962688:0@lo:104: 00000100:00100000:0.0:1787602445.805751:0:11171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602445.805797:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41486400/0x576b7af90af468e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af468da expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602445.805805:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41486400/0x576b7af90af468e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af468da expref: 18 pid: 5827 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602445.805814:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874436838962816:0@lo:104: 00000100:00100000:0.0:1787602445.805834:0:11171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602445.805847:0:11171:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4900ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602445.805921:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838962560 00000100:00100000:2.0:1787602445.805928:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838962560 00000100:00100000:2.0:1787602445.805966:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838962688 00000100:00100000:2.0:1787602445.805969:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838962688 00000100:00100000:2.0:1787602445.805977:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838962816 00000100:00100000:2.0:1787602445.805979:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838962816 00000100:00100000:2.0:1787602445.805991:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787602445.805999:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+5:11171:x1874436838962560:12345-0@lo:104: 00010000:00010000:2.0:1787602445.806010:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806085:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787602445.806092:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+5:11171:x1874436838962560:12345-0@lo:104: Request processed in 94us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602445.806099:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787602445.806115:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602445.806128:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+4:11171:x1874436838962688:12345-0@lo:104: 00010000:00010000:2.0:1787602445.806136:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806170:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787602445.806175:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+4:11171:x1874436838962688:12345-0@lo:104: Request processed in 49us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602445.806181:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602445.806193:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787602445.806198:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+3:11171:x1874436838962816:12345-0@lo:104: 00010000:00010000:2.0:1787602445.806205:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806236:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787602445.806241:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+3:11171:x1874436838962816:12345-0@lo:104: Request processed in 43us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602445.806246:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787602445.806267:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787602445.806273:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806279:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477200 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:2.0:1787602445.806283:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806291:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602445.806299:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602445.806311:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787602445.806352:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806359:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787602445.806376:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806382:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af468f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af468fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806394:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602445.806397:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806403:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476000 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:2.0:1787602445.806406:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806412:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602445.806418:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602445.806423:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787602445.806435:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806440:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787602445.806462:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806469:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41476000/0x576b7af90af468e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af468ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806478:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602445.806481:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806487:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71c00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:2.0:1787602445.806490:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806496:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602445.806502:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602445.806507:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787602445.806519:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806525:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787602445.806530:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806536:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a47d71c00/0x576b7af90af468da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af468e1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806548:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602445.806555:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602445.806557:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602445.806563:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602445.806582:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838962944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602445.806614:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602445.806658:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838963072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602445.806681:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602445.806698:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602445.806703:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838963200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602445.806721:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602445.806746:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838962944 00000100:00100000:2.0:1787602445.806750:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838962944 00010000:00010000:2.0:1787602445.806770:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41477e00/0x576b7af90af468fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af468f6 expref: 19 pid: 5826 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602445.806800:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838963072 00000100:00100000:2.0:1787602445.806803:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838963072 00010000:00010000:2.0:1787602445.806814:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a5890ca00/0x576b7af90af468ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af468e8 expref: 20 pid: 5828 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602445.806827:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838963200 00000100:00100000:2.0:1787602445.806830:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838963200 00010000:00010000:2.0:1787602445.806839:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41486400/0x576b7af90af468e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af468da expref: 21 pid: 5827 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602445.806851:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787602445.806857:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5c99bea-fdac-431e-b440-876dfd3e206e+21:3312:x1874436838962944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602445.806866:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602445.806871:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41477e00/0x576b7af90af468fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af468f6 expref: 21 pid: 5826 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806885:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41477e00/0x576b7af90af468fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af468f6 expref: 21 pid: 5826 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806899:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602445.806928:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5c99bea-fdac-431e-b440-876dfd3e206e+21:3312:x1874436838962944:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602445.806935:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787602445.806968:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787602445.806974:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5c99bea-fdac-431e-b440-876dfd3e206e+20:3313:x1874436838963072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602445.806981:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602445.806985:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a5890ca00/0x576b7af90af468ef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af468e8 expref: 20 pid: 5828 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.806993:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a5890ca00/0x576b7af90af468ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af468e8 expref: 20 pid: 5828 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.807002:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602445.807023:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5c99bea-fdac-431e-b440-876dfd3e206e+20:3313:x1874436838963072:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602445.807029:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787602445.807061:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787602445.807067:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838963200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602445.807075:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602445.807079:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41486400/0x576b7af90af468e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af468da expref: 19 pid: 5827 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.807087:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41486400/0x576b7af90af468e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af468da expref: 19 pid: 5827 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.807103:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602445.807123:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838963200:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602445.807130:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787602445.807168:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838962944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602445.807190:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838963200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602445.807197:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838963072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787602445.807397:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41477e00/0x576b7af90af468fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af468f6 expref: 18 pid: 5826 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602445.807408:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874436838962560:0@lo:104: 00010000:00010000:0.0:1787602445.807418:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890ca00/0x576b7af90af468ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af468e8 expref: 17 pid: 5828 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602445.807425:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874436838962688:0@lo:104: 00010000:00010000:0.0:1787602445.807433:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41486400/0x576b7af90af468e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af468da expref: 16 pid: 5827 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602445.807442:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874436838962816:0@lo:104: 00010000:00010000:1.0:1787602445.807584:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602445.813499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602445.813539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602445.813648:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874436838962304:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602445.813660:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1874436838962432:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602445.813693:0:11171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602445.813852:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821104640 00000100:00100000:3.0:1787602445.813860:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821104640 00010000:00010000:3.0:1787602445.813890:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41476400/0x576b7af90af46904 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc92 expref: 13 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602445.813919:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821104512 00000100:00100000:3.0:1787602445.813923:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821104512 00010000:00010000:3.0:1787602445.813936:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a47d70c00/0x576b7af90af46919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcca expref: 14 pid: 5827 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602445.813962:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 28 00000100:00100000:3.0:1787602445.813970:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:79237443-cd99-4e6f-9597-f72f9f4e4ed2+14:2362:x1874436821104640:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602445.813983:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602445.813988:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41476400/0x576b7af90af46904 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc92 expref: 14 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.813998:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41476400/0x576b7af90af46904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc92 expref: 14 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814014:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41476400/0x576b7af90af46904 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc92 expref: 14 pid: 5826 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814028:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602445.814101:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2362:x1874436821104640:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 130us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602445.814108:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 28 00000100:00100000:3.0:1787602445.814138:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 29 00000100:00100000:3.0:1787602445.814145:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:2362:x1874436821104512:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602445.814153:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602445.814158:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a47d70c00/0x576b7af90af46919 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcca expref: 12 pid: 5827 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814167:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a47d70c00/0x576b7af90af46919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcca expref: 12 pid: 5827 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814178:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d70c00/0x576b7af90af46919 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcca expref: 12 pid: 5827 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814189:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814198:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814211:0:8454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814218:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814225:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814232:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814238:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890da00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602445.814247:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814255:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814266:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602445.814275:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602445.814294:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:2362:x1874436821104512:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 150us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602445.814300:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 29 00010000:00010000:2.0:1787602445.814460:0:11171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.814469:0:11171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602445.814475:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890da00/0x576b7af90af46935 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1787602445.943922:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ebc1a79-d388-4b93-8c58-223a06e0bf6b 00000020:00000080:0.0:1787602445.943932:0:7648:0:(genops.c:885:class_export_put()) final put ffff944a7c47f800/3ebc1a79-d388-4b93-8c58-223a06e0bf6b 00000020:00000080:1.0:1787602445.944763:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c47f800/3ebc1a79-d388-4b93-8c58-223a06e0bf6b for lustre-OST0001 00000020:00000080:1.0:1787602445.948747:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a7c47c000 for lustre-OST0001 00010000:00010000:2.0:1787602446.813831:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602447.108266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602447.108858:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821104768 00000100:00100000:3.0:1787602447.108869:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821104768 00000100:00100000:3.0:1787602447.108926:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 225 00000100:00100000:3.0:1787602447.108936:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:5600:x1874436821104768:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602447.109136:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602447.109156:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70800/0x576b7af90af4693c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fcf4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602447.109181:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70800/0x576b7af90af4693c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcf4 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602447.109192:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70800/0x576b7af90af4693c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcf4 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602447.109201:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70800, rc 0) 00000100:00100000:3.0:1787602447.109288:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821104768:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 Request processed in 354us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602447.109305:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 225 00000100:00100000:3.0:1787602447.130812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602447.130851:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821104896 00000100:00100000:3.0:1787602447.130860:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821104896 00000100:00100000:3.0:1787602447.130908:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 226 00000100:00100000:3.0:1787602447.130919:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821104896:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602447.132596:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821104896:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 Request processed in 1667us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602447.132608:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 226 10000000:01000000:0.0:1787602447.134224:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602447.134230:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944945805800 from 7 10000000:01000000:0.0:1787602447.134235:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602447.134279:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602447.134304:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602447.134317:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602447.134341:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602447.134405:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602447.134701:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4900acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602447.134741:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838963328 00000100:00100000:1.0:1787602447.134749:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838963328 00000100:00100000:1.0:1787602447.134925:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787602447.134943:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838963328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602447.136373:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602447.136397:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41486000/0x576b7af90af4694a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46943 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602447.136425:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41486000/0x576b7af90af4694a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46943 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602447.136435:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41486000/0x576b7af90af4694a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46943 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602447.136444:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41486000, rc 0) 00000100:00100000:1.0:1787602447.136527:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838963328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1587us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602447.136535:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787602447.136629:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602447.136646:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602447.136656:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602447.136726:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602447.136760:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602447.137397:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4900acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602447.137448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602447.137467:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838963456 00000100:00100000:2.0:1787602447.137474:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838963456 00000100:00100000:2.0:1787602447.137508:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787602447.137524:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838963456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602447.137745:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838963456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602447.137753:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787602447.138268:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602447.138312:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602447.138356:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602447.138377:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787602447.138523:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838963584 00000100:00100000:2.0:1787602447.138528:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838963584 00000100:00100000:2.0:1787602447.138562:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787602447.138569:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838963584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602447.138724:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838963584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602447.138732:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787602447.138789:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787602447.139500:0:11216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787602447.139554:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787602447.139575:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787602447.139585:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602447.139594:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602447.139605:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787602447.139607:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a576b9000 from 7 10000000:01000000:2.0:1787602447.139610:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787602447.139638:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602447.139645:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602447.139663:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602447.139681:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787602447.139719:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602447.139745:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602447.139759:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838963712 00000100:00100000:2.0:1787602447.139763:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838963712 00000100:00100000:2.0:1787602447.139804:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787602447.139812:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838963712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602447.139821:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602447.139832:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41476000/0x576b7af90af46958 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46951 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602447.139851:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41476000/0x576b7af90af46958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46951 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602447.139859:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41476000/0x576b7af90af46958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46951 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602447.139867:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476000, rc 0) 00000100:00100000:2.0:1787602447.139895:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838963712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602447.139901:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787602447.139931:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602447.139942:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602447.139956:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602447.139998:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602447.140021:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602447.140032:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602447.140058:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838963840 00000100:00100000:2.0:1787602447.140061:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838963840 00000100:00100000:2.0:1787602447.140078:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787602447.140083:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838963840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602447.140288:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838963840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602447.140294:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787602447.140504:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602447.140534:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602447.140576:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602447.140602:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48e72000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602447.140649:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838963968 00000100:00100000:1.0:1787602447.140655:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838963968 00000100:00100000:1.0:1787602447.140690:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787602447.140698:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838963968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602447.140861:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838963968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602447.140867:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787602447.140954:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838963968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787602447.141880:0:11217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787602447.145625:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787602447.145672:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787602447.145684:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602447.145698:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602447.145710:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787602447.145712:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a487a1000 from 7 10000000:01000000:1.0:1787602447.145715:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787602447.145750:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602447.145758:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602447.145781:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602447.145808:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838964096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602447.145880:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602447.149736:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821105024 00000100:00100000:2.0:1787602447.149750:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821105024 00000100:00100000:3.0:1787602447.149830:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838964096 00000100:00100000:3.0:1787602447.149835:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838964096 00000100:00100000:1.0:1787602447.152376:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602447.155469:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 233 00000100:00100000:2.0:1787602447.155489:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821105024:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602447.155703:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821105024:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 Request processed in 221us (18256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602447.155712:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 233 00000100:00100000:1.0:1787602447.161850:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787602447.161869:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838964096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602447.161887:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602447.161905:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41487400/0x576b7af90af46966 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4695f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602447.161934:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41487400/0x576b7af90af46966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4695f expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602447.161959:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41487400/0x576b7af90af46966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4695f expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602447.161968:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487400, rc 0) 00000100:00100000:1.0:1787602447.162067:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838964096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (16186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602447.162074:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787602447.162102:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838964096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602447.162121:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602447.162131:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602447.162200:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838964224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602447.162242:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602447.162282:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48e72480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602447.162289:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838964224 00000100:00100000:1.0:1787602447.162295:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838964224 00000100:00100000:1.0:1787602447.162320:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787602447.162327:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838964224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602447.162563:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838964224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602447.162570:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787602447.162635:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838964224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602447.162665:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838964352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602447.162702:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602447.162723:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48e72480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602447.162795:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838964352 00000100:00100000:1.0:1787602447.162800:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838964352 00000100:00100000:1.0:1787602447.162818:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787602447.162824:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838964352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602447.162962:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838964352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602447.162969:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787602447.163213:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838964352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787602447.169225:0:11221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787602447.169287:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787602447.169305:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602447.169316:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602447.169328:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602447.173707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602447.173884:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821105152 00000100:00100000:3.0:1787602447.173893:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821105152 00000100:00100000:3.0:1787602447.175680:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 237 00000100:00100000:3.0:1787602447.175698:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821105152:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602447.175715:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602447.175731:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70c00/0x576b7af90af4696d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fcfb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602447.175759:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70c00/0x576b7af90af4696d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcfb expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602447.176132:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70c00/0x576b7af90af4696d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcfb expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602447.176142:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70c00, rc 0) 00000100:00100000:3.0:1787602447.176204:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:5600:x1874436821105152:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 Request processed in 513us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602447.176211:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 237 00000100:00100000:1.0:1787602447.186477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602447.186901:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821105280 00000100:00100000:2.0:1787602447.186912:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821105280 00000100:00100000:2.0:1787602447.186971:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 238 00000100:00100000:2.0:1787602447.186981:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:5600:x1874436821105280:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602447.187286:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:5600:x1874436821105280:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 Request processed in 305us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602447.187294:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 238 00000100:00100000:3.0:1787602447.190400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602447.192291:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821105408 00000100:00100000:1.0:1787602447.192306:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821105408 00000100:00100000:1.0:1787602447.192368:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 239 00000100:00100000:1.0:1787602447.192379:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:5600:x1874436821105408:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602447.192606:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:5600:x1874436821105408:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 Request processed in 228us (2215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602447.192614:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 239 00010000:00010000:2.0:1787602447.841909:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787602448.466501:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ebc1a79-d388-4b93-8c58-223a06e0bf6b 00000020:00000080:3.0:1787602448.466510:0:6717:0:(genops.c:885:class_export_put()) final put ffff944a7c47a000/3ebc1a79-d388-4b93-8c58-223a06e0bf6b 00000020:00000080:2.0:1787602448.467064:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c47a000/3ebc1a79-d388-4b93-8c58-223a06e0bf6b for lustre-OST0000 00000020:00000080:2.0:1787602448.467116:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a7c479800 for lustre-OST0000 00010000:00010000:3.0:1787602448.874982:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602448.925239:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838964608:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.925331:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602448.925384:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838965120:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.925411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602448.925442:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787602448.925449:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838964480:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.925480:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602448.925500:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838964992:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.925521:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602448.925560:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838964736:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.925584:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602448.925601:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602448.925607:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838964864:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.925628:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602448.925663:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838964608 00000100:00100000:1.0:1787602448.925670:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838964608 00000100:00100000:1.0:1787602448.925712:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838964992 00000100:00100000:1.0:1787602448.925715:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838964992 00000100:00100000:1.0:1787602448.925737:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838964736 00000100:00100000:1.0:1787602448.925740:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838964736 00000100:00100000:1.0:1787602448.925770:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787602448.925780:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838964608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.925830:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838964608:12345-0@lo:400:kworker.0 Request processed in 51us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602448.925849:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787602448.925869:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787602448.925876:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838964992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.925906:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838964992:12345-0@lo:400:kworker.0 Request processed in 32us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602448.925913:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787602448.925925:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787602448.925932:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838964736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.925961:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838964736:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602448.925967:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787602448.925985:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838965120 00000100:00100000:1.0:1787602448.925988:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838965120 00000100:00100000:1.0:1787602448.926013:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838964864 00000100:00100000:1.0:1787602448.926016:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838964864 00000100:00100000:1.0:1787602448.926066:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787602448.926075:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838965120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.926105:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838965120:12345-0@lo:400:kworker.0 Request processed in 32us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602448.926111:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787602448.926123:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787602448.926129:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838964864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.926155:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838964864:12345-0@lo:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602448.926161:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787602448.926187:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838964480 00000100:00100000:1.0:1787602448.926191:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838964480 00000100:00100000:1.0:1787602448.926216:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787602448.926222:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838964480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.926252:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838964480:12345-0@lo:400:kworker.0 Request processed in 30us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602448.926258:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:1.0:1787602448.926293:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602448.926297:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602448.926299:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787602448.926331:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ea4a680 x1874436838964864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602448.926345:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838964864:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.926357:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838964736:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.926388:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838964480:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.926397:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838964992:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.926406:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838964608:0@lo:400:kworker.0 00010000:00080000:1.0:1787602448.926416:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ea48000 x1874436838965120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602448.926425:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838965120:0@lo:400:kworker.0 00000100:00100000:1.0:1787602448.928466:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602448.928487:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838965248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602448.928625:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602448.928674:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838965248 00000100:00100000:1.0:1787602448.928694:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838965248 00000100:00100000:1.0:1787602448.928739:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787602448.928748:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838965248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602448.928792:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602448.928836:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838965248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602448.928843:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787602448.928879:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ea48000 x1874436838965248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602448.928895:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838965248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602449.166866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602449.166902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602449.166922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602449.167008:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821105664 00000100:00100000:1.0:1787602449.167017:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821105664 00000100:00080000:0.0:1787602449.167056:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602449.167111:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821105792 00000100:00100000:1.0:1787602449.167115:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821105792 00000100:00100000:1.0:1787602449.167142:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 79 00000100:00100000:0.0:1787602449.167149:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 80 00000100:00100000:1.0:1787602449.167152:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821105664:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602449.167157:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2362:x1874436821105792:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602449.167223:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2362:x1874436821105792:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 67us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602449.167230:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 80 00000100:00100000:1.0:1787602449.170438:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821105664:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 3277us (3570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602449.170452:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 79 00000100:00100000:1.0:1787602449.170499:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821105536 00000100:00100000:1.0:1787602449.170508:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821105536 00000100:00100000:1.0:1787602449.170555:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 241 00000100:00100000:1.0:1787602449.170565:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2362:x1874436821105536:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602449.170608:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2362:x1874436821105536:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 46us (3705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602449.170616:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 241 00000100:00080000:1.0:1787602449.170728:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787602449.831299:0:11372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787602449.889842:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602450.461559:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838965376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602450.461630:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602450.461722:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838965376 00000100:00100000:2.0:1787602450.461730:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838965376 00000100:00100000:2.0:1787602450.461813:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787602450.461822:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838965376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602450.461853:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787602450.461927:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602450.470542:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838965376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8712us (8902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602450.470557:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787602450.471372:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7512df80 x1874436838965376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602450.471396:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838965376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602450.909234:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602451.935648:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602452.958195:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787602453.190748:0:11471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:14:11 (1787602451) === 00000100:00100000:2.0:1787602453.326917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602453.326963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602453.327065:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821106048 00000100:00100000:3.0:1787602453.327075:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821106048 00000100:00100000:3.0:1787602453.327140:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:3.0:1787602453.327151:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:9684:x1874436821106048:12345-192.168.206.25@tcp:700:mkdir.0 00000100:00100000:3.0:1787602453.327231:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:9684:x1874436821106048:12345-192.168.206.25@tcp:700:mkdir.0 Request processed in 82us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602453.327239:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:0.0:1787602453.327316:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821105920 00000100:00100000:0.0:1787602453.327321:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821105920 00000100:00100000:0.0:1787602453.327362:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00100000:0.0:1787602453.327370:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821105920:12345-192.168.206.25@tcp:41:mkdir.0 00000004:00000024:0.0:1787602453.327399:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787602453.327446:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821105920:12345-192.168.206.25@tcp:41:mkdir.0 Request processed in 76us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602453.327453:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00080000:2.0:1787602453.327513:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602453.330362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602453.330459:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821106304 00000100:00100000:2.0:1787602453.330469:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821106304 00000100:00100000:3.0:1787602453.330709:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:3.0:1787602453.330722:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:9684:x1874436821106304:12345-192.168.206.25@tcp:36:mkdir.0 00010000:00010000:3.0:1787602453.331897:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602453.331925:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46855 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc7d expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.331946:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a4a576300) 00010000:00010000:3.0:1787602453.331957:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602453.332276:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46974 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.332290:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46974 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.332300:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46974 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.332371:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.332379:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.332387:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602453.341261:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787602453.341278:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46974 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.341298:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46974 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.341305:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46974 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.341311:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602453.341315:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46974 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.341322:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46974 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.341337:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602453.341339:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602453.341344:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46974 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.341349:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46974 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602453.341366:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2121d88 reply state 000000005baa9ba6 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602453.341374:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602453.341471:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:9684:x1874436821106304:12345-192.168.206.25@tcp:36:mkdir.0 Request processed in 10748us (11114us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787602453.341480:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 15 00010000:00010000:3.0:1787602453.350765:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.350854:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.350862:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.350868:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602453.350872:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.350880:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.350896:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff944a4a576600) 00010000:00010000:3.0:1787602453.350899:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602453.350904:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.350910:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4697b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602453.356017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602453.356088:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821106432 00000100:00100000:1.0:1787602453.356098:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821106432 00000100:00100000:1.0:1787602453.356145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:1.0:1787602453.356155:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:9685:x1874436821106432:12345-192.168.206.25@tcp:101:chmod.0 00010000:00010000:1.0:1787602453.356173:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602453.356194:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af46982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd02 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.356252:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af46989 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.356264:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af46989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.356274:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af46989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602453.356324:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787602453.356327:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602453.356362:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af46989 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.356398:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af46982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd02 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.356416:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af46989 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd02 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.356424:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a43b20100) 00010000:00010000:1.0:1787602453.356426:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602453.356429:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487e00, rc 0) 00000100:00100000:1.0:1787602453.356480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:9685:x1874436821106432:12345-192.168.206.25@tcp:101:chmod.0 Request processed in 326us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602453.356486:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:0.0:1787602453.376641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602453.376891:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821106688 00000100:00100000:3.0:1787602453.376901:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821106688 00000100:00100000:3.0:1787602453.376962:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00100000:3.0:1787602453.376973:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:9685:x1874436821106688:12345-192.168.206.25@tcp:36:chmod.0 00010000:00010000:3.0:1787602453.377026:0:9459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602453.377087:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af46989 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd02 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.377107:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a43b20100) 00010000:00010000:3.0:1787602453.377119:0:9459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602453.377144:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.377158:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.377168:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602453.377468:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e4db5ed reply state 00000000cba1ccdc transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602453.377478:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787602453.377492:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787602453.377619:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:9685:x1874436821106688:12345-192.168.206.25@tcp:36:chmod.0 Request processed in 632us (973us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787602453.377626:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 17 00010000:00010000:3.0:1787602453.382979:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.382998:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.383006:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.383013:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602453.383018:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.383025:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.383078:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a4a576300) 00010000:00010000:3.0:1787602453.383082:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787602453.383087:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.383094:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46990 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602453.405795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602453.406240:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821106816 00000100:00100000:1.0:1787602453.406250:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821106816 00000100:00100000:1.0:1787602453.406317:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00100000:1.0:1787602453.406330:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:9686:x1874436821106816:12345-192.168.206.25@tcp:101:chown.0 00010000:00010000:1.0:1787602453.406353:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602453.406374:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af46997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd09 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.406451:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af4699e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.406464:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af4699e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.406475:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af4699e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602453.406544:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787602453.406548:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602453.406589:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af4699e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.406616:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af46997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd09 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.406638:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af4699e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd09 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.406647:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a43b20d00) 00010000:00010000:1.0:1787602453.406650:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602453.406654:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487e00, rc 0) 00000100:00100000:2.0:1787602453.408406:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:9686:x1874436821106816:12345-192.168.206.25@tcp:101:chown.0 Request processed in 2069us (2609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602453.408434:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00100000:3.0:1787602453.412797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602453.412873:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821106944 00000100:00100000:2.0:1787602453.412883:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821106944 00000100:00100000:2.0:1787602453.412944:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:2.0:1787602453.412956:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:9686:x1874436821106944:12345-192.168.206.25@tcp:101:chown.0 00010000:00010000:2.0:1787602453.412977:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602453.412995:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af469a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd10 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413115:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af469ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413130:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af469ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413142:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af469ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413155:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af469b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413162:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af469b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413169:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af469b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413263:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af469ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413287:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af469ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413295:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af469ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602453.413331:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787602453.413335:0:9459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602453.413358:0:9459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af469ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413370:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af469ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413377:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af469ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413384:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af469ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413390:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602453.413395:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af469ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413402:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af469ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413413:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a43b20d00) 00010000:00010000:2.0:1787602453.413417:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602453.413421:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af469ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413438:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af469ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413453:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af469b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413458:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af469b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413464:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af469b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413469:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602453.413472:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af469b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413478:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af469b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413486:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff944a48947b00) 00010000:00010000:2.0:1787602453.413489:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602453.413492:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af469b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413497:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af469b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413543:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af469a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd10 expref: 10 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413557:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af469ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd10 expref: 9 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.413572:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a48947a00) 00010000:00010000:2.0:1787602453.413575:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602453.413577:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477800, rc 0) 00000100:00100000:2.0:1787602453.413659:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:9686:x1874436821106944:12345-192.168.206.25@tcp:101:chown.0 Request processed in 705us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602453.413667:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:3.0:1787602453.420164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602453.420264:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821107200 00000100:00100000:0.0:1787602453.420274:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821107200 00000100:00100000:0.0:1787602453.420345:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 20 00000100:00100000:0.0:1787602453.420356:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:9686:x1874436821107200:12345-192.168.206.25@tcp:36:chown.0 00010000:00010000:0.0:1787602453.420405:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602453.420446:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af469ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd10 expref: 9 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.420464:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a48947a00) 00010000:00010000:0.0:1787602453.420474:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602453.420498:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.420510:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.420519:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602453.470977:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ac32c25 reply state 000000001d30299e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602453.470994:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787602453.471174:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787602453.471279:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:9686:x1874436821107200:12345-192.168.206.25@tcp:36:chown.0 Request processed in 50921us (51121us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787602453.471288:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 20 00000001:00080000:0.0:1787602453.471327:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1787602453.472932:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.472956:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.472962:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.472986:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890c200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602453.472990:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.472998:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.473015:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a48aced00) 00010000:00010000:3.0:1787602453.473018:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787602453.473033:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.473055:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af469c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602453.494993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602453.495311:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821107328 00000100:00100000:0.0:1787602453.495321:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821107328 00000100:00100000:0.0:1787602453.495380:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00100000:0.0:1787602453.495390:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:9687:x1874436821107328:12345-192.168.206.25@tcp:101:touch.500 00010000:00010000:0.0:1787602453.495413:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602453.495559:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890d800/0x576b7af90af469c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd17 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602453.501241:0:5833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5606us 00010000:00010000:1.0:1787602453.532842:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af469cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.532864:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af469cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.532875:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af469cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.532890:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af469d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.532898:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af469d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.532918:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af469d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.533401:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af469dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.533411:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af469dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.533428:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af469dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602453.533508:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787602453.533512:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602453.533979:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af469dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.533994:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af469cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534002:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af469cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534009:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af469cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534016:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602453.534020:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af469cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534028:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af469cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534150:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a43b20d00) 00010000:00010000:1.0:1787602453.534153:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602453.534157:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af469cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534162:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af469cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534177:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af469d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534183:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af469d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534188:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af469d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534193:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41486400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602453.534196:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af469d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534201:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af469d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534208:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff944a43b20000) 00010000:00010000:1.0:1787602453.534210:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602453.534212:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af469d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534217:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af469d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534266:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890d800/0x576b7af90af469c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd17 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534281:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af469dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd17 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.534288:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a43b20e00) 00010000:00010000:1.0:1787602453.534290:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787602453.534292:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011dc00, rc 0) 00000100:00100000:1.0:1787602453.536016:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:9687:x1874436821107328:12345-192.168.206.25@tcp:101:touch.500 Request processed in 40621us (41026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602453.536027:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00100000:2.0:1787602453.545859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602453.545930:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821107584 00000100:00100000:0.0:1787602453.545939:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821107584 00000100:00100000:0.0:1787602453.545998:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 22 00000100:00100000:0.0:1787602453.546008:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:9687:x1874436821107584:12345-192.168.206.25@tcp:101:touch.500 00010000:00010000:0.0:1787602453.546027:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602453.546075:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af469e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd1e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.546592:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af469eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.546677:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af469eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.546689:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af469eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.546754:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.546762:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.546769:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602453.548774:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787602453.549266:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c800/0x576b7af90af469f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.549282:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c800/0x576b7af90af469f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.549369:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c800/0x576b7af90af469f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.549409:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af469eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.549417:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af469eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.549919:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af469eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.549935:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890ce00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602453.549939:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af469eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.549945:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af469eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.549958:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a43b20e00) 00010000:00010000:1.0:1787602453.549960:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602453.549964:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af469eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.549970:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af469eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602453.549983:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae70e987 reply state 00000000f2481141 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602453.549991:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787602453.550175:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af469e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd1e expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.550191:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c800/0x576b7af90af469f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd1e expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.550199:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff944a43b20000) 00010000:00010000:1.0:1787602453.550201:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602453.550203:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c800, rc 0) 00000100:00100000:1.0:1787602453.550274:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:9687:x1874436821107584:12345-192.168.206.25@tcp:101:touch.500 Request processed in 4267us (4421us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787602453.550289:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 22 00010000:00010000:3.0:1787602453.552673:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.552688:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.552695:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.552701:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890ca00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602453.552704:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.552709:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.552742:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff944a48ace100) 00010000:00010000:3.0:1787602453.552745:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602453.552750:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.552756:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af469f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602453.555818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602453.556767:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821107840 00000100:00100000:3.0:1787602453.556779:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821107840 00000100:00100000:3.0:1787602453.556845:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 23 00000100:00100000:3.0:1787602453.556856:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:9687:x1874436821107840:12345-192.168.206.25@tcp:36:touch.500 00010000:00010000:3.0:1787602453.556907:0:9459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602453.556932:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c800/0x576b7af90af469f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd1e expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.556951:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff944a43b20000) 00010000:00010000:3.0:1787602453.556963:0:9459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602453.557002:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.557015:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.557024:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602453.557173:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000061d76d3 reply state 00000000344e0af1 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602453.557199:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602453.557279:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:9687:x1874436821107840:12345-192.168.206.25@tcp:36:touch.500 Request processed in 425us (1469us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787602453.557286:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 23 00010000:00010000:3.0:1787602453.559234:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.559250:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.559257:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.559263:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602453.559268:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.559276:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.559291:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff944a4a576300) 00010000:00010000:3.0:1787602453.559294:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602453.559298:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.559304:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602453.566975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602453.567080:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821107968 00000100:00100000:0.0:1787602453.567093:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821107968 00000100:00100000:0.0:1787602453.567152:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 24 00000100:00100000:0.0:1787602453.567170:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:9687:x1874436821107968:12345-192.168.206.25@tcp:101:touch.500 00010000:00010000:0.0:1787602453.567191:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602453.567210:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46a0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd25 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.567265:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd25 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.567280:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46a0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd25 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.567297:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff944a48ace600) 00010000:00010000:0.0:1787602453.567300:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602453.567304:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890da00, rc 0) 00000100:00100000:0.0:1787602453.567359:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:9687:x1874436821107968:12345-192.168.206.25@tcp:101:touch.500 Request processed in 190us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602453.567366:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 24 00000100:00100000:1.0:1787602453.570824:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602453.570955:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821108096 00000100:00100000:2.0:1787602453.570964:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821108096 00000100:00100000:2.0:1787602453.571010:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:2.0:1787602453.571019:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1874436821108096:12345-192.168.206.25@tcp:8:touch.500 00010000:00080000:2.0:1787602453.571085:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:2.0:1787602453.571113:0:6692:0:(genops.c:1385:class_connect()) connect: client a41c7236-f364-42ee-9be0-a289b3ed94f6, cookie 0x576b7af90af46a15 00002000:00100000:2.0:1787602453.571125:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a41c7236-f364-42ee-9be0-a289b3ed94f6/ffff944a7560b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787602453.571146:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787602453.571679:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787602453.571710:0:6692:0:(import.c:65:import_set_state_nolock()) ffff944a7c86c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787602453.571789:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2360:x1874436821108096:12345-192.168.206.25@tcp:8:touch.500 Request processed in 769us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602453.571798:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:2.0:1787602453.574263:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602453.574353:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821108224 00000100:00100000:1.0:1787602453.574361:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821108224 00000100:00100000:1.0:1787602453.574428:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00100000:1.0:1787602453.574439:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:0:x1874436821108224:12345-192.168.206.25@tcp:2:touch.500 00000100:00080000:2.0:1787602453.574721:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787602453.621513:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1787602453.621529:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00000100:00100000:2.0:1787602453.621694:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:0:x1874436821108224:12345-192.168.206.25@tcp:2:touch.500 Request processed in 47252us (47433us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787602453.621705:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00100000:2.0:1787602453.627659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602453.627756:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821108480 00000100:00100000:0.0:1787602453.627765:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821108480 00000100:00100000:0.0:1787602453.627823:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:0.0:1787602453.627847:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:9687:x1874436821108480:12345-192.168.206.25@tcp:35:touch.500 00000100:00100000:0.0:1787602453.628229:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+11:9687:x1874436821108480:12345-192.168.206.25@tcp:35:touch.500 Request processed in 383us (579us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787602453.628238:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:0.0:1787602453.646251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602453.646458:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821108608 00000100:00100000:1.0:1787602453.646467:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821108608 00000100:00100000:1.0:1787602453.646529:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 25 00000100:00100000:1.0:1787602453.646540:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+11:9688:x1874436821108608:12345-192.168.206.25@tcp:101:rm.0 00010000:00010000:1.0:1787602453.646567:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602453.646587:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d400/0x576b7af90af46a1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd2c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.646651:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011da00/0x576b7af90af46a23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.646665:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011da00/0x576b7af90af46a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.646676:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011da00/0x576b7af90af46a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602453.646741:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787602453.646745:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602453.646791:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011da00/0x576b7af90af46a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.646817:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d400/0x576b7af90af46a1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd2c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.646848:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011da00/0x576b7af90af46a23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd2c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.646855:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a43b20e00) 00010000:00010000:1.0:1787602453.646858:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602453.646861:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011da00, rc 0) 00000100:00100000:1.0:1787602453.646925:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+12:9688:x1874436821108608:12345-192.168.206.25@tcp:101:rm.0 Request processed in 387us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602453.646932:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 25 00000100:00100000:2.0:1787602453.666380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602453.666496:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821108864 00000100:00100000:0.0:1787602453.666505:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821108864 00000100:00100000:0.0:1787602453.666562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 26 00000100:00100000:0.0:1787602453.666573:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+12:9688:x1874436821108864:12345-192.168.206.25@tcp:101:rm.0 00010000:00010000:0.0:1787602453.666592:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602453.666612:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af46a2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd33 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602453.666720:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787602453.668198:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af46a2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd33 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.668216:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a43b20d00) 00010000:00010000:0.0:1787602453.668219:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602453.668224:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ce00/0x576b7af90af46a2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd33 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.668241:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890ce00, rc 0) 00000100:00100000:0.0:1787602453.668307:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:9688:x1874436821108864:12345-192.168.206.25@tcp:101:rm.0 Request processed in 1736us (1934us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787602453.668315:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 26 00000100:00100000:2.0:1787602453.674924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602453.675095:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821108992 00000100:00100000:0.0:1787602453.675105:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821108992 00000100:00100000:0.0:1787602453.675154:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:0.0:1787602453.675164:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:9688:x1874436821108992:12345-192.168.206.25@tcp:37:rm.0 00000100:00100000:0.0:1787602453.681477:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:9688:x1874436821108992:12345-192.168.206.25@tcp:37:rm.0 Request processed in 6305us (6551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602453.681490:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:2.0:1787602453.687579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602453.692377:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821109248 00000100:00100000:3.0:1787602453.692392:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821109248 00000100:00100000:2.0:1787602453.693279:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:2.0:1787602453.693291:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a5058ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:9688:x1874436821109248:12345-192.168.206.25@tcp:35:rm.0 00000100:00100000:2.0:1787602453.693555:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a5058ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:9688:x1874436821109248:12345-192.168.206.25@tcp:35:rm.0 Request processed in 265us (5984us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787602453.693562:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:2.0:1787602453.707241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602453.707506:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821109504 00000100:00100000:1.0:1787602453.707515:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821109504 00000100:00100000:1.0:1787602453.707574:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 27 00000100:00100000:1.0:1787602453.707585:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:9688:x1874436821109504:12345-192.168.206.25@tcp:101:rm.0 00010000:00010000:1.0:1787602453.707608:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602453.707627:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46a38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd3a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.708344:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46a3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.708359:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46a3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.708371:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46a3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602453.708382:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787602453.708523:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46a38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd3a expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.708542:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46a3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd3a expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.708550:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a43b20e00) 00010000:00010000:1.0:1787602453.708553:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787602453.708557:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011ce00, rc 0) 00000100:00100000:1.0:1787602453.708630:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:9688:x1874436821109504:12345-192.168.206.25@tcp:101:rm.0 Request processed in 1046us (1397us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787602453.708645:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 27 00000100:00100000:1.0:1787602453.712391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602453.712487:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821109632 00000100:00100000:2.0:1787602453.712497:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821109632 00000100:00100000:2.0:1787602453.712557:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 28 00000100:00100000:2.0:1787602453.712567:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:9688:x1874436821109632:12345-192.168.206.25@tcp:41:rm.0 00000004:00000024:2.0:1787602453.712622:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787602453.712701:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:9688:x1874436821109632:12345-192.168.206.25@tcp:41:rm.0 Request processed in 136us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602453.712708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 28 00000100:00100000:2.0:1787602453.716696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602453.716941:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821109760 00000100:00100000:1.0:1787602453.716951:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821109760 00000100:00100000:1.0:1787602453.717005:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 29 00000100:00100000:1.0:1787602453.717016:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:9688:x1874436821109760:12345-192.168.206.25@tcp:101:rm.0 00010000:00010000:1.0:1787602453.717084:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602453.717102:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46a4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd41 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717158:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46a54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717172:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46a54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717182:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46a54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717213:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46a5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717220:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717227:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717325:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46a62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717334:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717340:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602453.717366:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787602453.717370:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602453.717385:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717397:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717404:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46a54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717542:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46a54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717560:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46a54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717566:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011cc00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602453.717570:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46a54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717578:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46a54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717708:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a43b20e00) 00010000:00010000:1.0:1787602453.717712:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602453.717717:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46a54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717725:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46a54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717749:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46a5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717755:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46a5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717761:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46a5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717766:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602453.717833:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46a5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717851:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46a5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717860:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff944a43b20000) 00010000:00010000:1.0:1787602453.717862:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602453.717865:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46a5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717870:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46a5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717904:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46a4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd41 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717917:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46a62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd41 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602453.717925:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff944a48ace600) 00010000:00010000:1.0:1787602453.717927:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602453.717929:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d200, rc 0) 00000100:00100000:1.0:1787602453.718129:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+17:9688:x1874436821109760:12345-192.168.206.25@tcp:101:rm.0 Request processed in 1114us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602453.718137:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 29 00000100:00100000:3.0:1787602453.731152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602453.731257:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821110016 00000100:00100000:2.0:1787602453.731268:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821110016 00000100:00100000:2.0:1787602453.731329:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 30 00000100:00100000:2.0:1787602453.731340:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+17:9688:x1874436821110016:12345-192.168.206.25@tcp:36:rm.0 00010000:00010000:2.0:1787602453.731394:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787602453.731420:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46a62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd41 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731440:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46a0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd25 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731464:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff944a48ace600) 00010000:00010000:2.0:1787602453.731482:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011da00/0x576b7af90af46a23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd2c expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731490:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a43b20e00) 00010000:00010000:2.0:1787602453.731494:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602453.731512:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477c00/0x576b7af90af46a69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731524:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477c00/0x576b7af90af46a69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731533:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477c00/0x576b7af90af46a69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731548:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731555:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731561:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731709:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46a77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731717:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46a77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.731743:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46a77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787602453.732602:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787602453.732614:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284838576167ns, next at 285838573957ns, rc = 0 00010000:00010000:2.0:1787602453.738433:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738455:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738467:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738476:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738482:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738488:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738718:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602453.738749:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46a77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738756:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46a77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738762:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46a77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738850:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602453.738854:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46a77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738861:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46a77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738873:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff944a48947b00) 00010000:00010000:2.0:1787602453.738876:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787602453.738880:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46a77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738886:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46a77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738906:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477c00/0x576b7af90af46a69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738912:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477c00/0x576b7af90af46a69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738917:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477c00/0x576b7af90af46a69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738922:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602453.738925:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477c00/0x576b7af90af46a69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738931:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477c00/0x576b7af90af46a69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738950:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a43b20e00) 00010000:00010000:2.0:1787602453.738952:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602453.738956:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477c00/0x576b7af90af46a69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602453.738961:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477c00/0x576b7af90af46a69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602453.738972:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007566e0b reply state 000000004c283d14 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602453.738981:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602453.739095:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:9688:x1874436821110016:12345-192.168.206.25@tcp:36:rm.0 Request processed in 7753us (7948us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787602453.739104:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 30 00010000:00010000:3.0:1787602453.740222:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602453.740232:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.740241:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602453.740245:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.740252:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.740265:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff944a48947b00) 00010000:00010000:3.0:1787602453.740267:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787602453.740271:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.740277:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46a7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602453.740970:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602453.740975:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602453.740977:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602453.741581:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.741595:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.741603:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.741609:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602453.741614:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.741715:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.741739:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf5fe9ce6 (ffff944a48947400) 00010000:00010000:3.0:1787602453.741743:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602453.741747:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.741753:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46a70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf5fe9ce6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602453.744852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602453.744934:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821110272 00000100:00100000:2.0:1787602453.744944:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821110272 00000100:00100000:2.0:1787602453.745008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:2.0:1787602453.745026:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:9688:x1874436821110272:12345-192.168.206.25@tcp:35:rm.0 00000100:00100000:2.0:1787602453.745313:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:9688:x1874436821110272:12345-192.168.206.25@tcp:35:rm.0 Request processed in 297us (470us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787602453.745320:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:0.0:1787602453.748168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602453.748824:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821110528 00000100:00100000:3.0:1787602453.748833:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821110528 00000100:00100000:3.0:1787602453.748885:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 31 00000100:00100000:3.0:1787602453.748894:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:9688:x1874436821110528:12345-192.168.206.25@tcp:36:rm.0 00010000:00010000:3.0:1787602453.748948:0:9459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787602453.748972:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46a3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd3a expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.748992:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af469dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd17 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.749003:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a43b20e00) 00010000:00010000:3.0:1787602453.749019:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487e00/0x576b7af90af4699e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd09 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.749031:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a43b20d00) 00010000:00010000:3.0:1787602453.749239:0:9459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602453.749262:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a85 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.749275:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.749284:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.749371:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.749379:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.749387:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.749953:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46a93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.749963:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46a93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.749971:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46a93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602453.751244:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787602453.751263:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46a93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751272:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46a93 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751394:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46a93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751403:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602453.751408:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46a93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751416:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46a93 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751493:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff944a4a576000) 00010000:00010000:3.0:1787602453.751497:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787602453.751503:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46a93 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751510:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46a93 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751532:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751539:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a85 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751545:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751551:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602453.751554:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751678:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a85 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751687:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a4a576300) 00010000:00010000:3.0:1787602453.751689:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602453.751693:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.751699:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46a85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602453.751712:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038d92508 reply state 00000000380d3193 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602453.751721:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602453.751827:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:9688:x1874436821110528:12345-192.168.206.25@tcp:36:rm.0 Request processed in 2930us (3893us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787602453.751840:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 31 00010000:00010000:3.0:1787602453.753319:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.753332:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.753339:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.753344:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602453.753347:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.753369:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.753381:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff944a4a576600) 00010000:00010000:3.0:1787602453.753383:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602453.753388:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.753394:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46a8c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602453.992991:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602454.045271:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602454.045370:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602454.045390:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838965632:0@lo:400:kworker.0 00000100:00100000:0.0:1787602454.045460:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602454.045520:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838965632 00000100:00100000:0.0:1787602454.045526:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838965632 00000100:00100000:0.0:1787602454.045563:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787602454.045570:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3311:x1874436838965632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602454.045622:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3311:x1874436838965632:12345-0@lo:400:kworker.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602454.045629:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787602454.045773:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838965632:0@lo:400:kworker.0 00000100:00100000:2.0:1787602454.046252:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838965504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602454.046457:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602454.050031:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838965504 00000100:00100000:1.0:1787602454.050059:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838965504 00000100:00100000:1.0:1787602454.050193:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787602454.050204:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838965504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602454.050241:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602454.050320:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838965504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (3863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602454.050327:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787602454.050369:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6ea4a680 x1874436838965504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602454.050388:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838965504:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787602454.050541:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602454.059077:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838966016:0@lo:400:kworker.0 00000100:00100000:0.0:1787602454.059176:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602454.059223:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602454.059230:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838966144:0@lo:400:kworker.0 00000100:00100000:0.0:1787602454.059257:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602454.059290:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838966016 00000100:00100000:0.0:1787602454.059309:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838966016 00000100:00100000:0.0:1787602454.059365:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787602454.059375:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838966016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602454.059424:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838966016:12345-0@lo:400:kworker.0 Request processed in 51us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602454.059431:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787602454.059454:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787602454.059480:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a751b1500 x1874436838966016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602454.059494:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838966016:0@lo:400:kworker.0 00000100:00100000:0.0:1787602454.059519:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838966144 00000100:00100000:0.0:1787602454.059522:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838966144 00000100:00100000:0.0:1787602454.059554:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787602454.059561:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838966144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602454.059595:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838966144:12345-0@lo:400:kworker.0 Request processed in 35us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602454.059602:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787602454.059616:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602454.059631:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838966144:0@lo:400:kworker.0 00000100:00100000:1.0:1787602454.060323:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436838965888:0@lo:400:kworker.0 00000100:00100000:1.0:1787602454.060363:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602454.060397:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602454.060404:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838965760:0@lo:400:kworker.0 00000100:00100000:1.0:1787602454.060426:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602454.060515:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838965888 00000100:00100000:2.0:1787602454.060521:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838965888 00000100:00100000:2.0:1787602454.060575:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838965760 00000100:00100000:2.0:1787602454.060579:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838965760 00000100:00100000:2.0:1787602454.060598:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787602454.060605:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436838965888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602454.060647:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436838965888:12345-0@lo:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602454.060653:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787602454.060667:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787602454.060673:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838965760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602454.060702:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838965760:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602454.060708:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787602454.060777:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602454.060801:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838965760:0@lo:400:kworker.0 00000100:00100000:1.0:1787602454.060810:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436838965888:0@lo:400:kworker.0 00000100:00100000:0.0:1787602454.283137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602454.283185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602454.283226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602454.283272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602454.283311:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821110912 00000100:00100000:0.0:1787602454.283320:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821110912 00000100:00100000:0.0:1787602454.283370:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:0.0:1787602454.283380:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821110912:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602454.283963:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821110656 00000100:00100000:3.0:1787602454.283969:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821110656 00000100:00100000:0.0:1787602454.283975:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821110912:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 595us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602454.283984:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:3.0:1787602454.284009:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 243 00000100:00100000:3.0:1787602454.284019:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2364:x1874436821110656:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602454.284077:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2364:x1874436821110656:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 59us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602454.284083:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 243 00000100:00100000:2.0:1787602454.284532:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821110784 00000100:00100000:2.0:1787602454.284538:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821110784 00000100:00100000:2.0:1787602454.284571:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821111040 00000100:00100000:2.0:1787602454.284575:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821111040 00000100:00100000:2.0:1787602454.284616:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 84 00000100:00100000:2.0:1787602454.284623:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:2364:x1874436821110784:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602454.285014:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:2364:x1874436821110784:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 390us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602454.285022:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 84 00000100:00100000:2.0:1787602454.285070:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 85 00000100:00100000:2.0:1787602454.285079:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821111040:12345-192.168.206.25@tcp:400:kworker.0 00000100:00080000:3.0:1787602454.285278:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602454.286892:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821111040:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 1807us (3699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602454.286904:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 85 00010000:00010000:1.0:1787602455.014387:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602455.581548:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602455.581570:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838966272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602455.581639:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602455.581796:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838966272 00000100:00100000:3.0:1787602455.581803:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838966272 00000100:00100000:3.0:1787602455.581854:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787602455.581864:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838966272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602455.581897:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602455.581948:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838966272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602455.581972:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787602455.582308:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7512fb80 x1874436838966272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602455.582327:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838966272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787602456.037857:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602457.055754:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787602457.806142:0:11623:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787602458.077190:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787602458.699320:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:0.0:1787602458.699340:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:0.0:1787602458.699346:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1787602458.699352:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787602458.699364:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1787602458.699490:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838966400:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787602458.699558:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602458.699638:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838966400 00000100:00100000:0.0:1787602458.699645:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838966400 00000100:00100000:0.0:1787602458.699695:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787602458.699715:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838966400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787602458.699741:0:8475:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787602458.699772:0:8475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8ca614, atime: 0x6a8ca614, ctime: 0x6a8ca614, blocks: 0x1 00010000:00010000:0.0:1787602458.699780:0:8475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e64d13b/0x576b7af90af46a9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.699795:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=289s v=(0 0) 00010000:00010000:0.0:1787602458.699800:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602458.699806:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e64d13b/0x576b7af90af46a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.699821:0:8475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e64d13b/0x576b7af90af46a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.699971:0:8475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e64d13b/0x576b7af90af46a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.699983:0:8475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e64d13b/0x576b7af90af46a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.700001:0:8475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787602458.702442:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602458.702453:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e64d13b/0x576b7af90af46a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.702465:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890ca00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602458.702470:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e64d13b/0x576b7af90af46a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.702481:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e64d13b/0x576b7af90af46a9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.702503:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e64d13b/0x576b7af90af46a9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.702510:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e64d13b/0x576b7af90af46a9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.702527:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602458.702529:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602458.702531:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787602458.702545:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602458.703571:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874436838966400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1135us (1280us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787602458.703588:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1787602458.703678:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a752d7b80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787602458.703685:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838966400:0@lo:6:osp-syn-1-0.0 00000020:00000080:2.0:1787602458.820292:0:11674:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd5481210 20000000:00000080:2.0:1787602458.820310:0:11674:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff944a6ee8c800 uarg=0000000000000000 20000000:01000000:2.0:1787602458.820343:0:11674:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787602458.820349:0:11674:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787602458.820354:0:11674:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787602458.821588:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787602458.825224:0:11674:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787602458.834366:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787602458.834425:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787602458.834480:0:11674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787602458.834497:0:11674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787602458.834514:0:11674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834532:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a47d70800/0x576b7af90af4693c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcf4 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834541:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41486000/0x576b7af90af4694a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46943 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834548:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41476000/0x576b7af90af46958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46951 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834566:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a41487400/0x576b7af90af46966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4695f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834574:0:11674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a47d70c00/0x576b7af90af4696d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcfb expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834582:0:11674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834619:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a47d70c00/0x576b7af90af4696d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcfb expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834634:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a47d70c00/0x576b7af90af4696d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcfb expref: 12 pid: 5826 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602458.834646:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874436838966528:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602458.834768:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41487400/0x576b7af90af46966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af4695f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834778:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41487400/0x576b7af90af46966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af4695f expref: 18 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602458.834786:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874436838966656:0@lo:104: 00000100:00100000:0.0:1787602458.834827:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602458.834869:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41476000/0x576b7af90af46958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af46951 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834878:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41476000/0x576b7af90af46958 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af46951 expref: 18 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602458.834894:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874436838966784:0@lo:104: 00000100:00100000:0.0:1787602458.834925:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602458.834952:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a41486000/0x576b7af90af4694a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af46943 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.834960:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff944a41486000/0x576b7af90af4694a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af46943 expref: 18 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602458.834968:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874436838966912:0@lo:104: 00000100:00100000:0.0:1787602458.834990:0:11674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602458.835024:0:11674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a47d70800/0x576b7af90af4693c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcf4 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602458.835033:0:11674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a47d70800/0x576b7af90af4693c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcf4 expref: 12 pid: 5828 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602458.835057:0:7635:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787602458.835065:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874436838967040:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602458.835072:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838966656 00000100:00100000:2.0:1787602458.835080:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838966656 00000100:00100000:2.0:1787602458.835116:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838966784 00000100:00100000:2.0:1787602458.835120:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838966784 00000100:00100000:2.0:1787602458.835132:0:7635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838966912 00000100:00100000:2.0:1787602458.835135:0:7635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838966912 00000100:00100000:0.0:1787602458.835136:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c2cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1787602458.835154:0:7635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787602458.835165:0:7635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+5:11674:x1874436838966656:12345-0@lo:104: 00010000:00010000:2.0:1787602458.835178:0:7635:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602458.835279:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787602458.835289:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+5:11674:x1874436838966784:12345-0@lo:104: 00010000:00010000:1.0:1787602458.835298:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835354:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602458.835361:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+5:11674:x1874436838966784:12345-0@lo:104: Request processed in 75us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602458.835374:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787602458.835392:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787602458.835398:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c531850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+4:11674:x1874436838966912:12345-0@lo:104: 00010000:00010000:1.0:1787602458.835406:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835437:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787602458.835442:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c531850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c5c99bea-fdac-431e-b440-876dfd3e206e+4:11674:x1874436838966912:12345-0@lo:104: Request processed in 45us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602458.835448:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787602458.835461:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787602458.835467:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835475:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477200 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:1.0:1787602458.835480:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835489:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602458.835497:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602458.835503:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602458.835530:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835537:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602458.835574:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835583:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41477200/0x576b7af90af46951 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46958 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835594:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602458.835598:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835604:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890de00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:1.0:1787602458.835607:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835614:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602458.835620:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602458.835625:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602458.835642:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835647:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602458.835653:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835659:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5890de00/0x576b7af90af46943 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4694a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835667:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602458.835674:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602458.835676:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602458.835688:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838967296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602458.835739:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602458.835769:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602458.835776:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838967168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602458.835797:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602458.835826:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838967296 00000100:00100000:1.0:1787602458.835831:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838967296 00010000:00010000:1.0:1787602458.835851:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41486000/0x576b7af90af4694a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46943 expref: 19 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602458.835870:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838967168 00000100:00100000:1.0:1787602458.835873:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838967168 00010000:00010000:1.0:1787602458.835886:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41476000/0x576b7af90af46958 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46951 expref: 20 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602458.835909:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787602458.835917:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5c99bea-fdac-431e-b440-876dfd3e206e+20:3312:x1874436838967296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602458.835927:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602458.835932:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41486000/0x576b7af90af4694a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46943 expref: 20 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835941:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41486000/0x576b7af90af4694a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af46943 expref: 20 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.835955:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602458.835991:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5c99bea-fdac-431e-b440-876dfd3e206e+20:3312:x1874436838967296:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602458.835998:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787602458.836018:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787602458.836025:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838967168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602458.836032:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602458.836061:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41476000/0x576b7af90af46958 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af46951 expref: 19 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.836070:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41476000/0x576b7af90af46958 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af46951 expref: 19 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.836080:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602458.836105:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838967168:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602458.836111:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787602458.836119:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838967168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602458.836134:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838967296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602458.836366:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602458.837020:0:7635:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602458.837029:0:7635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+3:11674:x1874436838966656:12345-0@lo:104: Request processed in 1866us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602458.837059:0:7635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787602458.837118:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874436838966656:0@lo:104: 00010000:00010000:0.0:1787602458.837129:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41476000/0x576b7af90af46958 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af46951 expref: 18 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.837755:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602458.837763:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.837772:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487a00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:1.0:1787602458.837776:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.837785:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602458.837792:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602458.837798:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602458.837828:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602458.838105:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874436838966784:0@lo:104: 00010000:00010000:0.0:1787602458.838136:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41486000/0x576b7af90af4694a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af46943 expref: 17 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602458.838147:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874436838966912:0@lo:104: 00000100:00100000:0.0:1787602458.838158:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874436838966528:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602458.838725:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787602458.838773:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838967424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602458.838829:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602458.838877:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838967424 00000100:00100000:2.0:1787602458.838885:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838967424 00010000:00010000:1.0:1787602458.838910:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602458.838914:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a41487400/0x576b7af90af46966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af4695f expref: 17 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.838924:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41487a00/0x576b7af90af4695f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af46966 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602458.838954:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787602458.838964:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:3313:x1874436838967424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602458.838976:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602458.838982:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a41487400/0x576b7af90af46966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af4695f expref: 17 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602458.839003:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a41487400/0x576b7af90af46966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af4695f expref: 17 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602458.839018:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41487400/0x576b7af90af46966 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af4695f expref: 17 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602458.839031:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602458.839671:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c5c99bea-fdac-431e-b440-876dfd3e206e+16:3313:x1874436838967424:12345-0@lo:103:ldlm_bl.0 Request processed in 706us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602458.839679:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787602458.839753:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838967424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787602458.839779:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602458.839781:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602458.839783:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602458.841962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602458.842889:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821111168 00000100:00100000:1.0:1787602458.842900:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821111168 00010000:00010000:1.0:1787602458.842938:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a47d70c00/0x576b7af90af4696d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcfb expref: 13 pid: 5826 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602458.842977:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:1.0:1787602458.842986:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821111168:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602458.842998:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602458.843003:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a47d70c00/0x576b7af90af4696d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcfb expref: 13 pid: 5826 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.843014:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a47d70c00/0x576b7af90af4696d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcfb expref: 13 pid: 5826 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.843030:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d70c00/0x576b7af90af4696d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcfb expref: 13 pid: 5826 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.843130:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602458.843262:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:2361:x1874436821111168:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 276us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602458.843270:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:0.0:1787602458.851210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602458.851302:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821111296 00000100:00100000:1.0:1787602458.851312:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821111296 00010000:00010000:1.0:1787602458.851350:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a47d70800/0x576b7af90af4693c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcf4 expref: 12 pid: 5828 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602458.851383:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 34 00000100:00100000:1.0:1787602458.851392:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:2362:x1874436821111296:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602458.851407:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602458.851412:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a47d70800/0x576b7af90af4693c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcf4 expref: 12 pid: 5828 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851423:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a47d70800/0x576b7af90af4693c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcf4 expref: 12 pid: 5828 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851453:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851461:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851475:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851481:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851487:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851555:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602458.851573:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d70800/0x576b7af90af4693c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcf4 expref: 12 pid: 5828 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602458.851589:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11674:1874436838967040:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602458.851627:0:11674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602458.851638:0:11674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851657:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890da00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602458.851662:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851669:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851680:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602458.851690:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602458.851761:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:2362:x1874436821111296:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 368us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602458.851770:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 34 00010000:00010000:2.0:1787602458.852857:0:11674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602458.852867:0:11674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890da00/0x576b7af90af46aa1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602459.101473:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602459.165291:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602459.165971:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838967680:0@lo:400:kworker.0 00000100:00100000:1.0:1787602459.166062:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838967808:0@lo:400:kworker.0 00000100:00100000:3.0:1787602459.166070:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602459.166105:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602459.166152:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838967808 00000100:00100000:1.0:1787602459.166160:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838967808 00000100:00100000:3.0:1787602459.166161:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838967680 00000100:00100000:3.0:1787602459.166167:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838967680 00000100:00100000:1.0:1787602459.166216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787602459.166220:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787602459.166229:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838967808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602459.166234:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:3311:x1874436838967680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602459.166288:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:3311:x1874436838967680:12345-0@lo:400:kworker.0 Request processed in 59us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602459.166298:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787602459.166306:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838967808:12345-0@lo:400:kworker.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602459.166314:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787602459.166351:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838967680:0@lo:400:kworker.0 00000100:00100000:1.0:1787602459.166357:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838967808:0@lo:400:kworker.0 00000100:00100000:2.0:1787602459.168538:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838967936:0@lo:400:kworker.0 00000100:00100000:2.0:1787602459.168763:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602459.168879:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838967552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602459.168908:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602459.168963:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838967552 00000100:00100000:3.0:1787602459.168971:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838967552 00000100:00100000:3.0:1787602459.169021:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787602459.169030:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874436838967552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602459.169085:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602459.169127:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874436838967552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602459.169135:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787602459.169231:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838967552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602459.169403:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838967936 00000100:00100000:1.0:1787602459.169415:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838967936 00000100:00100000:1.0:1787602459.169477:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787602459.169487:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838967936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602459.169539:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838967936:12345-0@lo:400:kworker.0 Request processed in 55us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602459.169546:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787602459.169734:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838967936:0@lo:400:kworker.0 00000100:00080000:3.0:1787602459.170000:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602459.170301:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838968064:0@lo:400:kworker.0 00000100:00100000:0.0:1787602459.170342:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602459.170412:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838968064 00000100:00100000:1.0:1787602459.170417:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838968064 00000100:00100000:1.0:1787602459.170461:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787602459.170468:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838968064:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787602459.170539:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602459.170679:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838968192:0@lo:400:kworker.0 00000100:00100000:3.0:1787602459.170728:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602459.170775:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838968192 00000100:00100000:3.0:1787602459.170779:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838968192 00000100:00100000:3.0:1787602459.170809:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787602459.170815:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838968192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602459.170851:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838968192:12345-0@lo:400:kworker.0 Request processed in 35us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602459.170857:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787602459.170894:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838968192:0@lo:400:kworker.0 00000100:00080000:2.0:1787602459.171015:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602459.171120:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838968064:12345-0@lo:400:kworker.0 Request processed in 652us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602459.171127:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787602459.171181:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7512ed80 x1874436838968064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602459.171191:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838968064:0@lo:400:kworker.0 00000100:00100000:0.0:1787602459.395621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602459.395662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602459.395697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602459.395805:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821111680 00000100:00100000:1.0:1787602459.395814:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821111680 00000100:00100000:1.0:1787602459.395878:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00100000:1.0:1787602459.395889:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821111680:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602459.395973:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821111680:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602459.395980:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00100000:3.0:1787602459.396515:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821111424 00000100:00100000:3.0:1787602459.396521:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821111424 00000100:00100000:3.0:1787602459.396570:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 245 00000100:00100000:3.0:1787602459.396579:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:2361:x1874436821111424:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602459.396621:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46526c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:2361:x1874436821111424:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 43us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602459.396628:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 245 00000100:00080000:3.0:1787602459.396670:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602459.397083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602459.404161:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821111552 00000100:00100000:2.0:1787602459.404175:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821111552 00000100:00100000:2.0:1787602459.404257:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821111808 00000100:00100000:2.0:1787602459.404262:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821111808 00000100:00080000:3.0:1787602459.404374:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602459.404463:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 89 00000100:00100000:2.0:1787602459.404475:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821111552:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602459.404561:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821111552:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 88us (8862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602459.404569:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 89 00000100:00100000:2.0:1787602459.404592:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 90 00000100:00100000:2.0:1787602459.404600:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821111808:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602459.404626:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821111808:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 28us (7545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602459.404631:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 90 00000100:00100000:3.0:1787602459.908149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602459.908799:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821111936 00000100:00100000:1.0:1787602459.908810:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821111936 00000100:00100000:1.0:1787602459.908868:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 246 00000100:00100000:1.0:1787602459.908879:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:5600:x1874436821111936:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602459.908895:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602459.908924:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011da00/0x576b7af90af46aa8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd48 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602459.908955:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011da00/0x576b7af90af46aa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd48 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602459.908965:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011da00/0x576b7af90af46aa8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd48 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602459.908975:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011da00, rc 0) 00000100:00100000:1.0:1787602459.909075:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821111936:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 Request processed in 197us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602459.909082:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 246 00000100:00100000:2.0:1787602459.913086:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602459.913174:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821112064 00000100:00100000:1.0:1787602459.913183:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821112064 00000100:00100000:1.0:1787602459.913307:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 247 00000100:00100000:1.0:1787602459.913318:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821112064:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602459.913765:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821112064:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 Request processed in 448us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602459.913775:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 247 00000100:00100000:2.0:1787602459.917337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602459.917465:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821112192 00000100:00100000:3.0:1787602459.917475:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821112192 00000100:00100000:3.0:1787602459.917526:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 248 00000100:00100000:3.0:1787602459.917536:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821112192:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602459.917771:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821112192:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 Request processed in 236us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602459.917780:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 248 00000100:00100000:3.0:1787602459.925169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602459.926032:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821112320 00000100:00100000:2.0:1787602459.926074:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821112320 00000100:00100000:2.0:1787602459.926148:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 249 00000100:00100000:2.0:1787602459.926158:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:9958:x1874436821112320:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787602459.927063:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:9958:x1874436821112320:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 903us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602459.927074:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 249 00000100:00100000:2.0:1787602459.936381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602459.936459:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821112448 00000100:00100000:0.0:1787602459.936470:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821112448 00000100:00100000:0.0:1787602459.936532:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 250 00000100:00100000:0.0:1787602459.936542:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:9958:x1874436821112448:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602459.936815:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:9958:x1874436821112448:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 273us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602459.936829:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 250 00000100:00100000:3.0:1787602459.942883:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602459.943156:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821112576 00000100:00100000:2.0:1787602459.943166:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821112576 00000100:00100000:2.0:1787602459.943273:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 251 00000100:00100000:2.0:1787602459.943284:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:5600:x1874436821112576:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602459.943308:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602459.943337:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41477c00/0x576b7af90af46aaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd4f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602459.943363:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41477c00/0x576b7af90af46aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd4f expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602459.943374:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41477c00/0x576b7af90af46aaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd4f expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602459.943383:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477c00, rc 0) 00000100:00100000:2.0:1787602459.943446:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:5600:x1874436821112576:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 Request processed in 164us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602459.943453:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 251 00000100:00100000:3.0:1787602459.954731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602459.955143:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821112704 00000100:00100000:1.0:1787602459.955153:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821112704 00000100:00100000:1.0:1787602459.955211:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 252 00000100:00100000:1.0:1787602459.955220:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:5600:x1874436821112704:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602459.955664:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:5600:x1874436821112704:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 Request processed in 443us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602459.955673:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 252 00000100:00100000:1.0:1787602459.971109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602459.971642:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821112832 00000100:00100000:2.0:1787602459.971652:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821112832 00000100:00100000:2.0:1787602459.971716:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 253 00000100:00100000:2.0:1787602459.971739:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:5600:x1874436821112832:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602459.972094:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:5600:x1874436821112832:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 Request processed in 355us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602459.972102:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 253 00000100:00100000:3.0:1787602459.975661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602459.975841:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821112960 00000100:00100000:0.0:1787602459.975852:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821112960 00000100:00100000:0.0:1787602459.975908:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 254 00000100:00100000:0.0:1787602459.975919:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:9961:x1874436821112960:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602459.976186:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:9961:x1874436821112960:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 267us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602459.976194:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 254 00000100:00100000:3.0:1787602459.981753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602459.984889:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821113088 00000100:00100000:2.0:1787602459.984903:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821113088 00000100:00100000:2.0:1787602459.985596:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 255 00000100:00100000:2.0:1787602459.985611:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:9961:x1874436821113088:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787602459.985870:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:9961:x1874436821113088:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 262us (4124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602459.985878:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 255 00010000:00010000:2.0:1787602460.127421:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787602460.445275:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602460.445282:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944945805800 from 7 10000000:01000000:0.0:1787602460.445287:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602460.445349:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602460.445362:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602460.445374:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602460.445399:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838968320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602460.445477:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602460.445578:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c2cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602460.445710:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838968320 00000100:00100000:1.0:1787602460.445718:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838968320 00000100:00100000:1.0:1787602460.445774:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787602460.445784:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:5830:x1874436838968320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602460.445797:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602460.445810:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011ca00/0x576b7af90af46abd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46ab6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.445833:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011ca00/0x576b7af90af46abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46ab6 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.445845:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011ca00/0x576b7af90af46abd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46ab6 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.445856:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011ca00, rc 0) 00000100:00100000:1.0:1787602460.445901:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838968320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602460.445909:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787602460.447530:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838968320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602460.448064:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602460.448078:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602460.448160:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838968448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602460.448270:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602460.448462:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602460.448511:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838968448 00000100:00100000:2.0:1787602460.448517:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838968448 00000100:00100000:2.0:1787602460.448634:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787602460.448645:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838968448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602460.449013:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838968448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602460.449020:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787602460.449117:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838968448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602460.449152:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838968576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602460.449190:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602460.449282:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602460.449437:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838968576 00000100:00100000:0.0:1787602460.449442:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838968576 00000100:00100000:0.0:1787602460.449536:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787602460.449545:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838968576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602460.449730:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838968576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602460.449736:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787602460.449806:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838968576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602460.452807:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11687:1874436838968704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602460.452890:0:11687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602460.455008:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602460.459063:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838968704 00000100:00100000:1.0:1787602460.459077:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838968704 00000100:00100000:1.0:1787602460.459140:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787602460.459151:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:11687:x1874436838968704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602460.459452:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4654e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:11687:x1874436838968704:12345-0@lo:502:llog_process_th.0 Request processed in 293us (6551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602460.459460:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787602460.459586:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11687:1874436838968704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787602460.459629:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602460.459643:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602460.459646:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787602460.459653:0:11687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff944945805800 00000020:00000080:3.0:1787602460.459655:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787602460.459858:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11687:1874436838968832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602460.459903:0:11687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602460.460007:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c48e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602460.464816:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838968832 00000100:00100000:1.0:1787602460.464831:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838968832 00000100:00100000:1.0:1787602460.464914:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787602460.464925:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:11687:x1874436838968832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602460.465235:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+17:11687:x1874436838968832:12345-0@lo:502:llog_process_th.0 Request processed in 310us (5330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602460.465244:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787602460.465607:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11687:1874436838968832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602460.465647:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602460.465655:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602460.465657:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787602460.465663:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787602460.465872:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787602460.465888:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787602460.465897:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.465907:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602460.465992:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787602460.465995:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a576b9000 from 7 10000000:01000000:1.0:1787602460.465998:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787602460.466025:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.466033:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.466067:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602460.466088:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838968960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602460.466203:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602460.466234:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d262000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602460.466250:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838968960 00000100:00100000:1.0:1787602460.466262:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838968960 00000100:00100000:1.0:1787602460.466292:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787602460.466299:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:5830:x1874436838968960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602460.466309:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602460.466319:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011c800/0x576b7af90af46acb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46ac4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.466338:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011c800/0x576b7af90af46acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46ac4 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.466348:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011c800/0x576b7af90af46acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46ac4 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.466356:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c800, rc 0) 00000100:00100000:1.0:1787602460.466387:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838968960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602460.466392:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787602460.466424:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838968960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602460.466435:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.466443:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602460.466480:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838969088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602460.466581:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602460.466596:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a75428cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602460.466608:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838969088 00000100:00100000:1.0:1787602460.466617:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838969088 00000100:00100000:1.0:1787602460.466638:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787602460.466645:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838969088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602460.467935:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838969088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1287us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602460.467944:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787602460.470757:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838969088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602460.470878:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838969216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602460.471003:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602460.471097:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c2cd780 going to sleep for 11 seconds 00000100:00100000:1.0:1787602460.471204:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838969216 00000100:00100000:1.0:1787602460.471210:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838969216 00000100:00100000:1.0:1787602460.471253:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787602460.471260:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838969216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602460.471481:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838969216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602460.471489:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787602460.476124:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838969216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602460.483144:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11690:1874436838969344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602460.483237:0:11690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602460.483281:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a60240480 going to sleep for 11 seconds 00000100:00100000:0.0:1787602460.483402:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838969344 00000100:00100000:0.0:1787602460.483410:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838969344 00000100:00100000:0.0:1787602460.483459:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787602460.483469:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:11690:x1874436838969344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602460.483685:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+18:11690:x1874436838969344:12345-0@lo:502:llog_process_th.0 Request processed in 217us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602460.483706:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787602460.484230:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11690:1874436838969344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602460.484269:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602460.484277:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602460.484279:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787602460.484285:0:11690:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff944a576b9000 00000020:00000080:2.0:1787602460.484288:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787602460.484363:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11690:1874436838969472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602460.484400:0:11690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602460.484421:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a50119b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602460.485028:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838969472 00000100:00100000:1.0:1787602460.485066:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838969472 00000100:00100000:1.0:1787602460.485104:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787602460.485186:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:11690:x1874436838969472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602460.485383:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+18:11690:x1874436838969472:12345-0@lo:502:llog_process_th.0 Request processed in 271us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602460.485390:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787602460.485619:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11690:1874436838969472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602460.485644:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602460.485650:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602460.485653:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787602460.485657:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787602460.486016:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787602460.486072:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602460.486083:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602460.486095:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602460.486194:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602460.486196:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a487a1000 from 7 10000000:01000000:0.0:1787602460.486199:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602460.486229:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602460.486237:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602460.486247:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602460.486265:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838969600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602460.486305:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602460.486335:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c2cd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787602460.486388:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838969600 00000100:00100000:2.0:1787602460.486394:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838969600 00000100:00100000:2.0:1787602460.486420:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787602460.486428:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:5830:x1874436838969600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602460.486437:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602460.486448:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a41477200/0x576b7af90af46ad9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af46ad2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602460.486467:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a41477200/0x576b7af90af46ad9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af46ad2 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602460.486476:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a41477200/0x576b7af90af46ad9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af46ad2 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602460.486484:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477200, rc 0) 00000100:00100000:2.0:1787602460.486609:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838969600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602460.486616:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787602460.486762:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838969600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602460.486845:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602460.486854:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602460.486903:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838969728:0@lo:501:ll_cfg_requeue.0 00000040:00080000:3.0:1787602460.487796:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787602460.487878:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602460.487925:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c2cd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602460.488371:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838969728 00000100:00100000:1.0:1787602460.488379:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838969728 00000100:00100000:1.0:1787602460.488428:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787602460.488438:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838969728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602460.488690:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838969728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602460.488720:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787602460.488816:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838969728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602460.488855:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838969856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602460.488897:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602460.488933:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c2cd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602460.489200:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838969856 00000100:00100000:1.0:1787602460.489205:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838969856 00000100:00100000:1.0:1787602460.489232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787602460.489239:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838969856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602460.489373:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:5830:x1874436838969856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602460.489380:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787602460.489473:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c5c99bea-fdac-431e-b440-876dfd3e206e:5830:1874436838969856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602460.489946:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11692:1874436838969984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602460.489985:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602460.490018:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c2cd780 going to sleep for 11 seconds 00000100:00100000:1.0:1787602460.490216:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838969984 00000100:00100000:1.0:1787602460.490221:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838969984 00000100:00100000:1.0:1787602460.490255:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787602460.490263:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:11692:x1874436838969984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602460.490409:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:11692:x1874436838969984:12345-0@lo:502:llog_process_th.0 Request processed in 148us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602460.490417:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787602460.490510:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11692:1874436838969984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602460.490536:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602460.490545:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602460.490548:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787602460.490554:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff944a487a1000 00000020:00000080:0.0:1787602460.490557:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787602460.490630:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11692:1874436838970112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602460.490663:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602460.490683:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838970112 00000100:00100000:0.0:1787602460.490687:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838970112 00000100:00100000:0.0:1787602460.490719:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787602460.490726:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:11692:x1874436838970112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602460.490990:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:11692:x1874436838970112:12345-0@lo:502:llog_process_th.0 Request processed in 263us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602460.490996:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787602460.491027:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a7c2cd780 going to sleep for 11 seconds 00000100:00100000:0.0:1787602460.491059:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c5c99bea-fdac-431e-b440-876dfd3e206e:11692:1874436838970112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602460.491076:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602460.491080:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602460.491085:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787602460.491089:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787602460.491611:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787602460.491628:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787602460.491638:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602460.491649:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602460.701486:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838970240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602460.701572:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602460.701703:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838970240 00000100:00100000:0.0:1787602460.701712:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838970240 00000100:00100000:0.0:1787602460.701765:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787602460.701782:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838970240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602460.701825:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602460.701874:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838970240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602460.701881:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787602460.701954:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a752d7100 x1874436838970240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602460.701984:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838970240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787602461.149867:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787602461.534007:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787602462.173188:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602463.197233:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787602463.829921:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1787602464.224550:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602464.285831:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787602464.285854:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838970368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602464.285923:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602464.285966:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838970368 00000100:00100000:3.0:1787602464.285974:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838970368 00000100:00100000:3.0:1787602464.286023:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787602464.286031:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838970368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602464.286079:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787602464.286116:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602464.286124:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838970368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602464.286131:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787602464.286145:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787602464.286151:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944a752d7b80, transno 4294967300 00000100:00100000:0.0:1787602464.286166:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838970368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602464.286486:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838970752:0@lo:400:kworker.0 00000100:00100000:1.0:1787602464.286517:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602464.286518:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838970496:0@lo:400:kworker.0 00000100:00100000:0.0:1787602464.286546:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602464.286548:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602464.286553:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838970624:0@lo:400:kworker.0 00000100:00100000:0.0:1787602464.286567:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838971008:0@lo:400:kworker.0 00000100:00100000:1.0:1787602464.286574:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602464.286589:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838970496 00000100:00100000:0.0:1787602464.286592:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838970496 00000100:00100000:0.0:1787602464.286618:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787602464.286624:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838970496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602464.286627:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838970880:0@lo:400:kworker.0 00000100:00100000:3.0:1787602464.286842:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838970752 00000100:00100000:3.0:1787602464.286847:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838970752 00000100:00100000:3.0:1787602464.286879:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838970624 00000100:00100000:3.0:1787602464.286882:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838970624 00000100:00100000:3.0:1787602464.286900:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787602464.286907:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436838970752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602464.289207:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602464.289319:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787602464.289333:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838970624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602464.289386:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838970624:12345-0@lo:400:kworker.0 Request processed in 59us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602464.289394:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787602464.289422:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838970880 00000100:00100000:2.0:1787602464.289429:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838970880 00000100:00100000:2.0:1787602464.289470:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787602464.289476:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838970880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602464.289511:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838970880:12345-0@lo:400:kworker.0 Request processed in 35us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602464.289517:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787602464.289565:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a6e6b2680 x1874436838970880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602464.289578:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838970880:0@lo:400:kworker.0 00000100:00080000:2.0:1787602464.289618:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602464.289623:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602464.289658:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602464.289699:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838971008 00000100:00100000:2.0:1787602464.289713:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838971008 00000100:00100000:2.0:1787602464.289737:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787602464.289741:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838971008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602464.289772:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838971008:12345-0@lo:400:kworker.0 Request processed in 30us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602464.289778:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787602464.289791:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602464.289807:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838971008:0@lo:400:kworker.0 00000100:00100000:0.0:1787602464.296633:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838970496:12345-0@lo:400:kworker.0 Request processed in 9999us (10077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602464.296662:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787602464.297401:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838970496:0@lo:400:kworker.0 00000100:00100000:3.0:1787602464.298130:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436838970752:12345-0@lo:400:kworker.0 Request processed in 11218us (11606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602464.298141:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787602464.299521:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838970624:0@lo:400:kworker.0 00000100:00100000:1.0:1787602464.299620:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838970752:0@lo:400:kworker.0 00000100:00100000:2.0:1787602464.514786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602464.514828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602464.514858:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821113216 00000100:00100000:2.0:1787602464.514863:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602464.514867:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821113216 00000100:00100000:2.0:1787602464.514893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602464.514916:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 272 00000100:00100000:1.0:1787602464.514926:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821113216:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602464.514955:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821113344 00000100:00100000:3.0:1787602464.514960:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821113344 00000100:00100000:3.0:1787602464.515001:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821113600 00000100:00100000:1.0:1787602464.515010:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821113216:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602464.515016:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821113600 00000100:00100000:0.0:1787602464.515065:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821113472 00000100:00100000:0.0:1787602464.515069:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821113472 00000100:00100000:0.0:1787602464.515101:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:0.0:1787602464.515109:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821113472:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602464.515140:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821113472:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 32us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602464.515147:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00080000:0.0:1787602464.515196:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602464.515201:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602464.515212:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 94 00000100:00100000:0.0:1787602464.515220:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821113344:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602464.515253:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821113344:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602464.515260:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 94 00000100:00100000:3.0:1787602464.515535:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 95 00000100:00100000:3.0:1787602464.515544:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821113600:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602464.515581:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821113600:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 38us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602464.515588:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 95 00000100:00100000:1.0:1787602464.518814:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 272 00010000:00010000:1.0:1787602465.246119:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602465.821413:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838971136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602465.821519:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602465.821756:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838971136 00000100:00100000:3.0:1787602465.821767:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838971136 00000100:00100000:3.0:1787602465.821832:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787602465.821844:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838971136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602465.821888:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602465.821960:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838971136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602465.821968:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787602465.822180:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a752d7480 x1874436838971136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602465.822202:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838971136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602466.272365:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602467.294377:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602468.317304:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602469.341281:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602469.405369:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436838971520:0@lo:400:kworker.0 00000100:00100000:1.0:1787602469.405445:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602469.405511:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787602469.405517:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838971392:0@lo:400:kworker.0 00000100:00100000:1.0:1787602469.405541:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602469.405575:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838971904:0@lo:400:kworker.0 00000100:00100000:1.0:1787602469.405600:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602469.405637:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838971520 00000100:00100000:1.0:1787602469.405655:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838971520 00000100:00100000:1.0:1787602469.405704:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838971392 00000100:00100000:1.0:1787602469.405708:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838971392 00000100:00100000:1.0:1787602469.405731:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787602469.405741:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436838971520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602469.405795:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436838971520:12345-0@lo:400:kworker.0 Request processed in 55us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602469.405802:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787602469.405820:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787602469.405827:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838971392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602469.405856:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838971392:12345-0@lo:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602469.405861:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787602469.405882:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838971904 00000100:00100000:1.0:1787602469.405886:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838971904 00000100:00100000:1.0:1787602469.405910:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787602469.405917:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838971904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602469.405948:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838971904:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602469.405954:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787602469.405969:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602469.405973:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602469.406008:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838971392:0@lo:400:kworker.0 00000100:00100000:1.0:1787602469.406020:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838971904:0@lo:400:kworker.0 00000100:00100000:1.0:1787602469.406063:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436838971520:0@lo:400:kworker.0 00000100:00100000:2.0:1787602469.406203:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838971264:0@lo:400:kworker.0 00000100:00100000:2.0:1787602469.406239:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602469.406272:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838971776:0@lo:400:kworker.0 00000100:00100000:2.0:1787602469.406295:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602469.406323:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602469.406328:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838971648:0@lo:400:kworker.0 00000100:00100000:2.0:1787602469.406350:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602469.406408:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838971776 00000100:00100000:3.0:1787602469.406412:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838971776 00000100:00100000:3.0:1787602469.406446:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787602469.406453:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838971776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602469.406484:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838971776:12345-0@lo:400:kworker.0 Request processed in 32us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602469.406490:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1787602469.406537:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602469.406556:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838971776:0@lo:400:kworker.0 00000100:00100000:1.0:1787602469.406751:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838971264 00000100:00100000:1.0:1787602469.406755:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838971264 00000100:00100000:1.0:1787602469.406784:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787602469.406790:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838971264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602469.406829:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838971264:12345-0@lo:400:kworker.0 Request processed in 39us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602469.406835:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787602469.406903:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838971264:0@lo:400:kworker.0 00000100:00100000:0.0:1787602469.407094:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838971648 00000100:00100000:0.0:1787602469.407100:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838971648 00000100:00100000:0.0:1787602469.407147:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787602469.407155:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838971648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602469.407196:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838971648:12345-0@lo:400:kworker.0 Request processed in 43us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602469.407209:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787602469.407249:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a46253b80 x1874436838971648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602469.407261:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838971648:0@lo:400:kworker.0 00000100:00080000:2.0:1787602469.407369:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602469.407465:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838972032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602469.407494:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602469.407549:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838972032 00000100:00100000:3.0:1787602469.407553:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838972032 00000100:00100000:3.0:1787602469.407600:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787602469.407607:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838972032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602469.407641:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602469.411448:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838972032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3829us (3940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602469.411463:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787602469.411586:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838972032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602469.634685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602469.634733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602469.634789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602469.634825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602469.634860:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821113728 00000100:00100000:2.0:1787602469.634872:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821113728 00000100:00100000:2.0:1787602469.634932:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 274 00000100:00100000:2.0:1787602469.634943:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2364:x1874436821113728:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602469.635025:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2364:x1874436821113728:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602469.635034:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 274 00000100:00100000:2.0:1787602469.635104:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821113984 00000100:00100000:2.0:1787602469.635108:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821113984 00000100:00100000:2.0:1787602469.635152:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00100000:2.0:1787602469.635158:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821113984:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602469.635188:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821113984:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602469.635194:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00080000:2.0:1787602469.635214:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602469.635452:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821113856 00000100:00100000:3.0:1787602469.635459:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821113856 00000100:00100000:3.0:1787602469.635522:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821114112 00000100:00100000:3.0:1787602469.635526:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821114112 00000100:00100000:3.0:1787602469.635566:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 99 00000100:00100000:3.0:1787602469.635577:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821113856:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602469.635619:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821113856:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 45us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602469.635628:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 99 00000100:00100000:3.0:1787602469.635667:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 100 00000100:00100000:3.0:1787602469.635676:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821114112:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602469.635722:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821114112:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 47us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602469.635729:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 100 00000100:00080000:0.0:1787602469.635738:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787602470.365350:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602470.942113:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838972160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602470.942207:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602470.942560:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838972160 00000100:00100000:1.0:1787602470.942572:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838972160 00000100:00100000:1.0:1787602470.942646:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787602470.942658:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838972160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602470.942705:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602470.942825:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838972160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602470.942832:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787602470.943356:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a752d7480 x1874436838972160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602470.944664:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838972160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787602471.389740:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787602471.775185:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787602472.414024:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602473.439083:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602474.461254:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602474.525373:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436838972544:0@lo:400:kworker.0 00000100:00100000:1.0:1787602474.525461:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602474.525547:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787602474.525554:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838972416:0@lo:400:kworker.0 00000100:00100000:1.0:1787602474.525579:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602474.525596:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838972928:0@lo:400:kworker.0 00000100:00100000:1.0:1787602474.525633:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602474.525698:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838972928 00000100:00100000:1.0:1787602474.525708:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838972928 00000100:00100000:1.0:1787602474.525774:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787602474.525787:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838972928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602474.525851:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838972928:12345-0@lo:400:kworker.0 Request processed in 67us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602474.525859:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787602474.525909:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838972928:0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526183:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838972288:0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526235:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602474.526265:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838972800:0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526290:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602474.526314:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602474.526320:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838972672:0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526368:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602474.526400:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838972288 00000100:00100000:3.0:1787602474.526405:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838972288 00000100:00100000:3.0:1787602474.526437:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787602474.526444:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838972288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526481:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838972288:12345-0@lo:400:kworker.0 Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602474.526487:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787602474.526520:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838972544 00000100:00100000:3.0:1787602474.526524:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838972544 00000100:00100000:3.0:1787602474.526553:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838972416 00000100:00100000:3.0:1787602474.526556:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838972416 00000100:00100000:3.0:1787602474.526566:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838972800 00000100:00100000:3.0:1787602474.526568:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838972800 00000100:00100000:3.0:1787602474.526581:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787602474.526587:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436838972544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526634:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436838972544:12345-0@lo:400:kworker.0 Request processed in 47us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602474.526641:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787602474.526654:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787602474.526660:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838972416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526687:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838972416:12345-0@lo:400:kworker.0 Request processed in 28us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602474.526694:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787602474.526706:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787602474.526712:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838972800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526737:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838972800:12345-0@lo:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602474.526750:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787602474.526770:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838972672 00000100:00100000:3.0:1787602474.526774:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838972672 00000100:00100000:3.0:1787602474.526800:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787602474.526806:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838972672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526837:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838972672:12345-0@lo:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602474.526843:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787602474.526890:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a46253b80 x1874436838972672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602474.526904:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838972672:0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526914:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838972288:0@lo:400:kworker.0 00000100:00100000:3.0:1787602474.526923:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838972800:0@lo:400:kworker.0 00000100:00100000:1.0:1787602474.527295:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838972416:0@lo:400:kworker.0 00000100:00100000:1.0:1787602474.527309:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7be21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436838972544:0@lo:400:kworker.0 00000100:00100000:1.0:1787602474.527671:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7512ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838973056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602474.527712:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787602474.527815:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602474.527821:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787602474.527824:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602474.536100:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838973056 00000100:00100000:2.0:1787602474.536122:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838973056 00000100:00100000:2.0:1787602474.536229:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787602474.536243:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838973056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602474.536292:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602474.536413:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838973056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (8699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602474.536421:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787602474.536790:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7512ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838973056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602474.757735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602474.757857:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821114240 00000100:00100000:1.0:1787602474.757869:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821114240 00000100:00100000:1.0:1787602474.757952:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 276 00000100:00100000:1.0:1787602474.757973:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821114240:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602474.758107:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821114240:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 136us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602474.758116:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 276 00000100:00100000:0.0:1787602474.761853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602474.762698:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821114368 00000100:00100000:3.0:1787602474.762720:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821114368 00000100:00100000:3.0:1787602474.762818:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 104 00000100:00100000:3.0:1787602474.762830:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821114368:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602474.762936:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821114368:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 108us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602474.762945:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 104 00000100:00080000:0.0:1787602474.763393:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602474.784374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602474.787583:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821114496 00000100:00100000:1.0:1787602474.787607:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821114496 00000100:00100000:1.0:1787602474.787881:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:1.0:1787602474.787895:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2360:x1874436821114496:12345-192.168.206.25@tcp:9:kworker.0 00000020:00000080:1.0:1787602474.787954:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46a15 00000100:00080000:1.0:1787602474.787964:0:6692:0:(import.c:65:import_set_state_nolock()) ffff944a7c86c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787602474.788064:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787602474.788453:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+2:2360:x1874436821114496:12345-192.168.206.25@tcp:9:kworker.0 Request processed in 559us (4092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602474.788463:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 19 00010000:00010000:2.0:1787602474.790196:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787602474.796276:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602474.797118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602474.797404:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821114624 00000100:00100000:0.0:1787602474.797424:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821114624 00000100:00100000:0.0:1787602474.797807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 105 00000100:00100000:0.0:1787602474.797820:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821114624:12345-192.168.206.25@tcp:400:kworker.0 00000100:00080000:1.0:1787602474.798059:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602474.799554:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821114624:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 88us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602474.799572:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 105 00010000:00010000:2.0:1787602475.487311:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602476.062011:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602476.062848:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838973184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602476.062922:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602476.067803:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838973184 00000100:00100000:2.0:1787602476.067816:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838973184 00000100:00100000:2.0:1787602476.067906:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787602476.067917:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838973184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602476.067955:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602476.068066:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838973184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (5143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602476.068074:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787602476.068219:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a752d7480 x1874436838973184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602476.068240:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838973184:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787602476.069891:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602476.509390:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602477.533373:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602478.557947:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787602479.276459:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:1.0:1787602479.276472:0:7648:0:(genops.c:885:class_export_put()) final put ffff944a7560b000/a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:0.0:1787602479.276607:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7560b000/a41c7236-f364-42ee-9be0-a289b3ed94f6 for lustre-OST0001 00000020:00000080:0.0:1787602479.276669:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a7c86c000 for lustre-OST0001 00010000:00010000:1.0:1787602479.583290:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602479.646299:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602479.646497:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838973568:0@lo:400:kworker.0 00000100:00100000:3.0:1787602479.646511:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838973312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602479.646742:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838973440:0@lo:400:kworker.0 00000100:00100000:1.0:1787602479.646861:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602479.646907:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602479.646933:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838974080:0@lo:400:kworker.0 00000100:00100000:3.0:1787602479.646976:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838973696:0@lo:400:kworker.0 00000100:00100000:1.0:1787602479.646977:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602479.647028:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602479.647148:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602479.647155:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838973824:0@lo:400:kworker.0 00000100:00100000:3.0:1787602479.647181:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602479.647283:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602479.647318:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838973952:0@lo:400:kworker.0 00000100:00100000:2.0:1787602479.647345:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602479.647930:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838973312 00000100:00100000:2.0:1787602479.647938:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838973312 00000100:00100000:2.0:1787602479.647992:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787602479.648018:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838973568 00000100:00100000:3.0:1787602479.648020:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838973696 00000100:00100000:1.0:1787602479.648026:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838973568 00000100:00100000:3.0:1787602479.648029:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838973696 00000100:00100000:1.0:1787602479.648083:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838973952 00000100:00100000:1.0:1787602479.648089:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838973952 00000100:00100000:1.0:1787602479.648105:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787602479.648112:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838973568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602479.648168:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838973568:12345-0@lo:400:kworker.0 Request processed in 56us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602479.648175:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787602479.648191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787602479.648198:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838973952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602479.648229:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436838973952:12345-0@lo:400:kworker.0 Request processed in 32us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602479.648248:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787602479.648267:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838974080 00000100:00100000:1.0:1787602479.648271:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838974080 00000100:00100000:1.0:1787602479.648290:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838973824 00000100:00100000:1.0:1787602479.648293:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838973824 00000100:00100000:1.0:1787602479.648313:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787602479.648319:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874436838974080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602479.648351:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874436838974080:12345-0@lo:400:kworker.0 Request processed in 32us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602479.648358:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787602479.648373:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787602479.648383:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838973824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602479.648447:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838973824:12345-0@lo:400:kworker.0 Request processed in 66us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602479.648455:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787602479.648459:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787602479.648478:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602479.648482:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602479.648484:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602479.648533:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838973696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602479.648613:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838973696:12345-0@lo:400:kworker.0 Request processed in 85us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602479.649226:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838973312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602479.649264:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602479.649315:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838973312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1314us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602479.649323:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787602479.649354:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838973440 00000100:00100000:2.0:1787602479.649359:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838973440 00000100:00100000:2.0:1787602479.650025:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787602479.650033:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838973440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602479.650095:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3313:x1874436838973440:12345-0@lo:400:kworker.0 Request processed in 63us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602479.650103:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787602479.650379:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838973568:0@lo:400:kworker.0 00000100:00100000:3.0:1787602479.650395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787602479.650396:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838974080:0@lo:400:kworker.0 00000100:00100000:1.0:1787602479.650476:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5c99bea-fdac-431e-b440-876dfd3e206e:3313:1874436838973440:0@lo:400:kworker.0 00000100:00100000:1.0:1787602479.650487:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a46250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838973952:0@lo:400:kworker.0 00010000:00080000:1.0:1787602479.652009:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944947d68e00 x1874436838973824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602479.652027:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838973824:0@lo:400:kworker.0 00000100:00100000:1.0:1787602479.652081:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838973696:0@lo:400:kworker.0 00000100:00100000:1.0:1787602479.652109:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838973312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602479.875640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602479.875681:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602479.875707:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821114752 00000100:00100000:3.0:1787602479.875715:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821114752 00000100:00100000:3.0:1787602479.875759:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 278 00000100:00100000:3.0:1787602479.875768:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2362:x1874436821114752:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602479.875832:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2362:x1874436821114752:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602479.875840:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 278 00000100:00100000:0.0:1787602479.876227:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821114880 00000100:00100000:0.0:1787602479.876233:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821114880 00000100:00100000:0.0:1787602479.876282:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 109 00000100:00100000:0.0:1787602479.876289:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821114880:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602479.876327:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821114880:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 39us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602479.876334:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 109 00000100:00080000:3.0:1787602479.877387:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602479.887379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602479.887564:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821115008 00000100:00100000:3.0:1787602479.887573:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821115008 00000100:00100000:3.0:1787602479.887644:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 110 00000100:00100000:3.0:1787602479.887654:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2362:x1874436821115008:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602479.887724:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2362:x1874436821115008:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 71us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602479.887732:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 110 00000100:00080000:1.0:1787602479.888119:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602480.607959:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602481.195635:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838974208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602481.195706:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602481.195817:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838974208 00000100:00100000:3.0:1787602481.195825:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838974208 00000100:00100000:3.0:1787602481.195919:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787602481.195930:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838974208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602481.195964:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602481.196010:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838974208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602481.196017:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787602481.196083:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787602481.196111:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a752d7480 x1874436838974208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602481.196142:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838974208:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602481.629335:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787602482.019671:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787602482.653167:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787602482.772929:0:11857:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:14:40 (1787602480) 00010000:00010000:2.0:1787602483.683373:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602484.321780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602484.321880:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821115136 00000100:00100000:0.0:1787602484.321890:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821115136 00000100:00100000:0.0:1787602484.321965:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 32 00000100:00100000:0.0:1787602484.321978:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:10228:x1874436821115136:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602484.321997:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602484.322019:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46ae0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602484.322116:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46ae7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602484.322130:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602484.322143:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602484.322314:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787602484.322318:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602484.322414:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602484.322458:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46ae0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd56 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602484.322475:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd56 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602484.322482:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48acee00) 00010000:00010000:0.0:1787602484.322484:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602484.322487:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890cc00, rc 0) 00000100:00100000:0.0:1787602484.322544:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:10228:x1874436821115136:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 568us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602484.322551:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 32 00000100:00080000:1.0:1787602484.323284:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602484.330145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602484.330269:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821115264 00000100:00100000:3.0:1787602484.330278:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821115264 00000100:00100000:3.0:1787602484.330325:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:3.0:1787602484.330336:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:10229:x1874436821115264:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602484.330355:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602484.330375:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46aee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd5d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.330427:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46af5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.330441:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.330464:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.330477:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46afc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.330484:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.330491:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.330855:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70000/0x576b7af90af46b03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.330864:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70000/0x576b7af90af46b03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.330871:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70000/0x576b7af90af46b03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602484.330942:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787602484.330947:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602484.331018:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70000/0x576b7af90af46b03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331029:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331070:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46af5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331087:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46af5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331093:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602484.331097:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46af5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331105:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46af5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331117:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48acee00) 00010000:00010000:3.0:1787602484.331120:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602484.331124:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46af5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331130:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331141:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331146:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46afc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331152:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331157:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602484.331160:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331173:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46afc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331180:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff944a4a576a00) 00010000:00010000:3.0:1787602484.331182:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602484.331185:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46afc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331190:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46afc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331215:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46aee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd5d expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331226:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70000/0x576b7af90af46b03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd5d expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602484.331232:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff944a4a576100) 00010000:00010000:3.0:1787602484.331234:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602484.331236:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70000, rc 0) 00000100:00100000:3.0:1787602484.331288:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:10229:x1874436821115264:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 954us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602484.331295:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:0.0:1787602484.335597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602484.335685:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821115520 00000100:00100000:2.0:1787602484.335695:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821115520 00000100:00100000:2.0:1787602484.335751:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 34 00000100:00100000:2.0:1787602484.335762:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:10229:x1874436821115520:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602484.335781:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602484.335824:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.335889:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b11 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.335903:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b11 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.335913:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b11 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.335972:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b18 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.335981:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.335988:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336506:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46b1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336516:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46b1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336523:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46b1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602484.336532:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787602484.336754:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b11 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336774:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b11 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336781:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b11 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336786:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602484.336790:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b11 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336796:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b11 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336807:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff944a4a576100) 00010000:00010000:2.0:1787602484.336810:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602484.336814:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336819:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336830:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336835:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b18 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336840:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b18 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336844:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602484.336851:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b18 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336857:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b18 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336864:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff944a48947c00) 00010000:00010000:2.0:1787602484.336866:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602484.336869:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b18 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.336873:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b18 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.337279:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd64 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.337293:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46b1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd64 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602484.337299:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:2.0:1787602484.337301:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602484.337303:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476a00, rc 0) 00000100:00100000:2.0:1787602484.337363:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:10229:x1874436821115520:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 1602us (1774us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787602484.337371:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 34 00000100:00100000:0.0:1787602484.347439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602484.347579:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821115648 00000100:00100000:3.0:1787602484.347590:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821115648 00000100:00100000:3.0:1787602484.347651:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:3.0:1787602484.347661:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:10229:x1874436821115648:12345-192.168.206.25@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787602484.347782:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:10229:x1874436821115648:12345-192.168.206.25@tcp:59:lhsmtool_posix.0 Request processed in 121us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602484.347790:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 35 00010000:00010000:2.0:1787602484.701289:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602484.765437:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838974336:0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.765536:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602484.765611:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838974848:0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.765645:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602484.765674:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602484.765680:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838974720:0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.765713:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602484.765751:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838974464:0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.765786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602484.765807:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838974976:0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.765846:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602484.765883:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602484.765893:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838974592:0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.765925:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602484.765974:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838974720 00000100:00100000:1.0:1787602484.765981:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838974720 00000100:00100000:1.0:1787602484.766085:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838974976 00000100:00100000:1.0:1787602484.766090:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838974976 00000100:00100000:1.0:1787602484.766139:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787602484.766154:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838974720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.766207:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838974720:12345-0@lo:400:kworker.0 Request processed in 60us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602484.766215:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787602484.766235:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787602484.766242:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838974976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.766270:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838974976:12345-0@lo:400:kworker.0 Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602484.766277:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787602484.766295:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838974848 00000100:00100000:1.0:1787602484.766299:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838974848 00000100:00100000:1.0:1787602484.766322:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838974464 00000100:00100000:1.0:1787602484.766325:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838974464 00000100:00100000:1.0:1787602484.766334:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838974592 00000100:00100000:1.0:1787602484.766336:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838974592 00000100:00100000:1.0:1787602484.766347:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787602484.766354:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838974848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.766386:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838974848:12345-0@lo:400:kworker.0 Request processed in 33us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602484.766393:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787602484.766415:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787602484.766424:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838974464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.766456:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838974464:12345-0@lo:400:kworker.0 Request processed in 35us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602484.766462:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787602484.766472:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787602484.766479:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838974592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.766508:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838974592:12345-0@lo:400:kworker.0 Request processed in 30us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602484.766514:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1787602484.766539:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602484.766544:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602484.766546:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602484.766599:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838974592:0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.766612:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838974464:0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.766622:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838974976:0@lo:400:kworker.0 00010000:00080000:1.0:1787602484.766655:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c62e300 x1874436838974720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602484.766665:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838974720:0@lo:400:kworker.0 00000100:00100000:1.0:1787602484.766675:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838974848:0@lo:400:kworker.0 00000100:00100000:0.0:1787602484.766811:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838974336 00000100:00100000:0.0:1787602484.766816:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838974336 00000100:00100000:0.0:1787602484.766853:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787602484.766860:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838974336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602484.766901:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838974336:12345-0@lo:400:kworker.0 Request processed in 42us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602484.766907:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787602484.766937:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838974336:0@lo:400:kworker.0 00000100:00100000:2.0:1787602484.767420:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602484.767433:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838975104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602484.767474:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602484.767527:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838975104 00000100:00100000:2.0:1787602484.767532:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838975104 00000100:00100000:2.0:1787602484.767582:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787602484.767591:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838975104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602484.767621:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602484.767670:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838975104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602484.767677:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787602484.768880:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838975104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602485.003872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602485.003918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602485.004124:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821115776 00000100:00100000:2.0:1787602485.004142:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821115776 00000100:00100000:2.0:1787602485.004183:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 280 00000100:00100000:2.0:1787602485.004194:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821115776:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602485.004265:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821115776:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 73us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602485.004272:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 280 00000100:00100000:1.0:1787602485.004914:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821115904 00000100:00100000:1.0:1787602485.004920:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821115904 00000100:00100000:1.0:1787602485.004979:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 114 00000100:00100000:1.0:1787602485.004988:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2363:x1874436821115904:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602485.005065:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2363:x1874436821115904:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 79us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602485.005073:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 114 00000100:00080000:2.0:1787602485.005294:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787602485.087782:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787602485.729618:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602486.303296:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838975232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602486.303367:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602486.303514:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838975232 00000100:00100000:3.0:1787602486.303522:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838975232 00000100:00100000:3.0:1787602486.303588:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787602486.303599:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838975232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602486.303631:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602486.307561:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838975232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3945us (4175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602486.307576:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787602486.307618:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787602486.308141:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c62f480 x1874436838975232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602486.308166:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838975232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602486.467285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602486.475222:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821116032 00000100:00100000:2.0:1787602486.475236:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821116032 00000100:00100000:2.0:1787602486.475494:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00100000:2.0:1787602486.475506:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:10271:x1874436821116032:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:2.0:1787602486.475525:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602486.475545:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46b2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd6b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475617:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475648:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475662:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475677:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475684:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475692:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475937:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475945:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475952:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475958:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602486.475963:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475985:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.475997:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48acee00) 00010000:00010000:2.0:1787602486.476006:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602486.476011:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.476017:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.476030:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.476065:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.476071:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.476076:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602486.476079:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.476084:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.476092:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff944a48947c00) 00010000:00010000:2.0:1787602486.476095:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602486.476098:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.476103:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.477103:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46b2d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd6b expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.477199:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48acee00) 00010000:00010000:2.0:1787602486.477202:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602486.477206:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46b2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd6b expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.477217:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476000, rc 0) 00000100:00100000:2.0:1787602486.477292:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:10271:x1874436821116032:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1788us (10012us total) trans 0 rc 301/301 00000100:00100000:2.0:1787602486.477300:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00080000:3.0:1787602486.478317:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602486.489665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602486.489743:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821116288 00000100:00100000:3.0:1787602486.489751:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821116288 00000100:00100000:3.0:1787602486.489806:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 37 00000100:00100000:3.0:1787602486.489816:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:10271:x1874436821116288:12345-192.168.206.25@tcp:36:lfs.0 00010000:00010000:3.0:1787602486.489869:0:9459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602486.489896:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46ae7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd56 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.489914:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48acee00) 00010000:00010000:3.0:1787602486.489923:0:9459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602486.492310:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46b42 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.492343:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46b42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.492354:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46b42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.492368:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.492376:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.492382:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602486.496373:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787602486.496390:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46b42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.496400:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46b42 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.496408:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46b42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.496414:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602486.496418:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46b42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.496426:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46b42 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.496451:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:3.0:1787602486.496454:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602486.496458:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46b42 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.496464:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46b42 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602486.496486:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bf9da3f reply state 00000000e330ac61 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602486.496495:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602486.496633:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:10271:x1874436821116288:12345-192.168.206.25@tcp:36:lfs.0 Request processed in 6814us (6972us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787602486.496642:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 37 00010000:00010000:3.0:1787602486.503090:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.503109:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.503117:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.503123:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602486.503128:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.503135:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.503163:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff944a4a576000) 00010000:00010000:3.0:1787602486.503167:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602486.503171:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.503178:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46b49 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602486.617188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602486.617400:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821116416 00000100:00100000:2.0:1787602486.617410:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821116416 00000100:00100000:2.0:1787602486.617474:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 38 00000100:00100000:2.0:1787602486.617483:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:10280:x1874436821116416:12345-192.168.206.25@tcp:101:lctl.0 00010000:00010000:2.0:1787602486.617505:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602486.617525:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46b50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.617593:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.617607:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.617618:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602486.617672:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787602486.617698:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602486.617744:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.617768:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46b50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd72 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.617783:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd72 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.617791:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:2.0:1787602486.617794:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602486.617797:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477600, rc 0) 00000100:00100000:2.0:1787602486.617863:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:10280:x1874436821116416:12345-192.168.206.25@tcp:101:lctl.0 Request processed in 380us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602486.617871:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 38 00000100:00100000:0.0:1787602486.721253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602486.721364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821116544 00000100:00100000:1.0:1787602486.721374:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821116544 00000100:00100000:1.0:1787602486.721431:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:1.0:1787602486.721441:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:10286:x1874436821116544:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602486.721461:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602486.721480:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46b5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd79 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721540:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46b65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721563:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46b65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721575:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46b65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721601:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46b6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721608:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46b6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721614:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46b6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721718:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af46b73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721726:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af46b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721733:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af46b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602486.721762:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787602486.721766:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602486.721804:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af46b73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721815:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46b65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721933:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46b65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721941:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46b65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721955:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011cc00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602486.721959:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46b65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721966:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46b65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721977:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:1.0:1787602486.721979:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602486.721983:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46b65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.721988:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46b65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.722002:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46b6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.722007:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46b6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.722012:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46b6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.722017:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602486.722019:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46b6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.722024:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46b6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.722099:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff944a43b20f00) 00010000:00010000:1.0:1787602486.722102:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602486.722105:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46b6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.722110:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46b6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.722140:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46b5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd79 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.722152:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af46b73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd79 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.722158:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:1.0:1787602486.722160:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787602486.722163:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011dc00, rc 0) 00000100:00100000:1.0:1787602486.725732:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+11:10286:x1874436821116544:12345-192.168.206.25@tcp:101:bash.0 Request processed in 4279us (4474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602486.725745:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:3.0:1787602486.734417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602486.734520:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821116800 00000100:00100000:2.0:1787602486.734529:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821116800 00000100:00100000:2.0:1787602486.734625:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 40 00000100:00100000:2.0:1787602486.734636:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+11:10286:x1874436821116800:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:2.0:1787602486.734656:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602486.734676:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46b7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.734799:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.734814:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.734841:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.734856:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.734863:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.734869:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787602486.735434:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787602486.735597:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735607:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735616:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735644:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735652:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735659:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735665:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602486.735675:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735683:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735695:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:2.0:1787602486.735698:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602486.735702:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735709:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46b81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602486.735721:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005809af42 reply state 00000000507fa02d transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602486.735729:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787602486.735753:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46b7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd80 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735765:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd80 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.735772:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a48947b00) 00010000:00010000:2.0:1787602486.735774:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602486.735776:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476400, rc 0) 00000100:00100000:2.0:1787602486.735845:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:10286:x1874436821116800:12345-192.168.206.25@tcp:101:bash.0 Request processed in 1197us (1423us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787602486.735853:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 40 00010000:00010000:3.0:1787602486.738677:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.738692:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.738701:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.738706:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602486.738710:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.738717:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.738732:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a48947400) 00010000:00010000:3.0:1787602486.738735:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602486.738739:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.738745:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af46b88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602486.739495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602486.739644:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821116928 00000100:00100000:1.0:1787602486.739653:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821116928 00000100:00100000:1.0:1787602486.739698:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 20 00000100:00100000:1.0:1787602486.739706:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1874436821116928:12345-192.168.206.25@tcp:8:bash.0 00010000:00080000:1.0:1787602486.739736:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:1.0:1787602486.739762:0:6694:0:(genops.c:1385:class_connect()) connect: client a41c7236-f364-42ee-9be0-a289b3ed94f6, cookie 0x576b7af90af46b9d 00002000:00100000:1.0:1787602486.739773:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a41c7236-f364-42ee-9be0-a289b3ed94f6/ffff944a7c513800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602486.739887:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602486.740272:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787602486.740300:0:6694:0:(import.c:65:import_set_state_nolock()) ffff944a7c515000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602486.740393:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2360:x1874436821116928:12345-192.168.206.25@tcp:8:bash.0 Request processed in 686us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602486.740400:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 20 00000100:00100000:0.0:1787602486.742434:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602486.742624:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821117056 00000100:00100000:1.0:1787602486.742633:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821117056 00000100:00100000:1.0:1787602486.742733:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00100000:1.0:1787602486.742744:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:0:x1874436821117056:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602486.742759:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602486.742779:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aff5bf08/0x576b7af90af46ba4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd87 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787602486.742806:0:8475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602486.742822:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=317s v=(0 0) 00010000:00010000:1.0:1787602486.742827:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602486.742838:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aff5bf08/0x576b7af90af46ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd87 expref: 7 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.742858:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aff5bf08/0x576b7af90af46ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd87 expref: 7 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.742872:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c000, rc 0) 00000100:00100000:1.0:1787602486.742930:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:0:x1874436821117056:12345-192.168.206.25@tcp:101:bash.0 Request processed in 188us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602486.742952:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00080000:3.0:1787602486.744188:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602486.746099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602486.746206:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821117184 00000100:00100000:2.0:1787602486.746215:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821117184 00000100:00100000:2.0:1787602486.746264:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 22 00000100:00100000:2.0:1787602486.746272:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:10286:x1874436821117184:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:2.0:1787602486.746288:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602486.746305:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd8e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.746331:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aff5bf08/0x576b7af90af46ba4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd87 expref: 8 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.746340:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602486.746343:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602486.746348:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.746386:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aff5bf08/0x576b7af90af46ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd87 expref: 8 pid: 8475 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.746398:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aff5bf08/0x576b7af90af46ba4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd87 expref: 8 pid: 8475 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602486.746417:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea48700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1874436838975360:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602486.746497:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602486.749029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602486.749130:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821117312 00000100:00100000:3.0:1787602486.749138:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821117312 00010000:00010000:3.0:1787602486.749171:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aff5bf08/0x576b7af90af46ba4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd87 expref: 9 pid: 8475 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602486.749206:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:3.0:1787602486.749214:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2362:x1874436821117312:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602486.749225:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602486.749244:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aff5bf08/0x576b7af90af46ba4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd87 expref: 9 pid: 8475 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.749257:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aff5bf08/0x576b7af90af46ba4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd87 expref: 9 pid: 8475 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.749281:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602486.749285:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602486.749292:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 9 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.749301:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 9 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602486.749330:0:7636:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 9 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602486.749364:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c485c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7636:1874436838975488:192.168.206.25@tcp:105: 00000100:00100000:3.0:1787602486.749434:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a57d6c000 going to sleep for 11 seconds 00010000:00010000:1.0:1787602486.749852:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aff5bf08/0x576b7af90af46ba4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd87 expref: 9 pid: 8475 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602486.749868:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea48700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1874436838975360:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602486.749890:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.749900:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476000, rc 0) 00000100:00100000:1.0:1787602486.749939:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:10286:x1874436821117184:12345-192.168.206.25@tcp:101:bash.0 Request processed in 3668us (3847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602486.749946:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 22 00010000:00010000:1.0:1787602486.749996:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602486.752668:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c485c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7636:1874436838975488:192.168.206.25@tcp:105: 00010000:00010000:3.0:1787602486.752694:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602486.753414:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821117312:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 4189us (4382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602486.753426:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:1.0:1787602486.753649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602486.753703:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821117568 00000100:00100000:0.0:1787602486.753710:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821117568 00000100:00100000:0.0:1787602486.753756:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:0.0:1787602486.753767:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:10286:x1874436821117568:12345-192.168.206.25@tcp:35:bash.0 00000100:00100000:0.0:1787602486.754224:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:10286:x1874436821117568:12345-192.168.206.25@tcp:35:bash.0 Request processed in 457us (575us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787602486.754230:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:3.0:1787602486.846967:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602486.847165:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821117824 00000100:00100000:1.0:1787602486.847174:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821117824 00000100:00100000:1.0:1787602486.847236:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 41 00000100:00100000:1.0:1787602486.847246:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:10296:x1874436821117824:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602486.847270:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602486.847289:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46bb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd95 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602486.847390:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787602486.847508:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46bb2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd95 expref: 16 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.847541:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:1.0:1787602486.847544:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602486.847559:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46bb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd95 expref: 16 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.847572:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c000, rc 0) 00000100:00100000:1.0:1787602486.847904:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:10296:x1874436821117824:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 657us (944us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787602486.847913:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 41 00000100:00100000:3.0:1787602486.854956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602486.855111:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821118080 00000100:00100000:2.0:1787602486.855120:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821118080 00000100:00100000:2.0:1787602486.855188:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:2.0:1787602486.855213:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:10296:x1874436821118080:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:2.0:1787602486.855468:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:10296:x1874436821118080:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 256us (520us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787602486.855475:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:2.0:1787602486.981848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602486.981947:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821118208 00000100:00100000:1.0:1787602486.981957:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821118208 00000100:00100000:1.0:1787602486.982014:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 42 00000100:00100000:1.0:1787602486.982024:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:10302:x1874436821118208:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602486.982070:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602486.982089:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46bc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fd9c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.982163:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46bc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.982177:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.982190:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602486.982242:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787602486.982258:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602486.982285:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.982313:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46bc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd9c expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.982331:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd9c expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.982338:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:1.0:1787602486.982341:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602486.982344:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d000, rc 0) 00000100:00100000:1.0:1787602486.982407:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+17:10302:x1874436821118208:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 384us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602486.982413:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 42 00000100:00100000:3.0:1787602486.985254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602486.985689:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821118464 00000100:00100000:1.0:1787602486.985704:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821118464 00000100:00100000:1.0:1787602486.985775:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00100000:1.0:1787602486.985785:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+17:10302:x1874436821118464:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602486.985807:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602486.985829:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46bce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fda3 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.985948:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46bd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.985962:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.985985:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602486.985996:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787602486.986171:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46bce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fda3 expref: 20 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.986190:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fda3 expref: 19 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.986199:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a48947b00) 00010000:00010000:1.0:1787602486.986202:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602486.986205:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011ce00, rc 0) 00000100:00100000:1.0:1787602486.986269:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:10302:x1874436821118464:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 485us (1029us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787602486.986276:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00100000:3.0:1787602486.990612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602486.990738:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821118592 00000100:00100000:2.0:1787602486.990753:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821118592 00000100:00100000:2.0:1787602486.990834:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:2.0:1787602486.990846:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:2362:x1874436821118592:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602486.990863:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602486.990888:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46bd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fda3 expref: 19 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602486.990908:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a48947b00) 00010000:00010000:2.0:1787602486.990914:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602486.990998:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+18:2362:x1874436821118592:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 140us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602486.991005:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:3.0:1787602486.991589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602486.991726:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821118848 00000100:00100000:1.0:1787602486.991734:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821118848 00000100:00100000:1.0:1787602486.991784:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 44 00000100:00100000:1.0:1787602486.991793:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+18:10302:x1874436821118848:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602486.991813:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602486.991834:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46be3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fdaa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.991913:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46bea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.991942:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46bea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.991953:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46bea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602486.991965:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787602486.992257:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46be3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdaa expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.992275:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46bea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdaa expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602486.992283:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a48947b00) 00010000:00010000:1.0:1787602486.992286:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787602486.992289:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c600, rc 0) 00000100:00100000:1.0:1787602486.992411:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:10302:x1874436821118848:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 618us (824us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787602486.992830:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 44 00000100:00100000:3.0:1787602487.003354:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602487.010852:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821118976 00000100:00100000:1.0:1787602487.010866:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821118976 00000100:00100000:1.0:1787602487.010933:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 23 00000100:00100000:1.0:1787602487.010944:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821118976:12345-192.168.206.25@tcp:1:lfs.0 00010000:00010000:1.0:1787602487.010987:0:8475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.011008:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.011029:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787602487.011033:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602487.011065:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.011323:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.011341:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 7 pid: 6692 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602487.011357:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8475:1874436838975616:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602487.013780:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e6a4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787602487.020194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602487.021223:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821119104 00000100:00100000:0.0:1787602487.021233:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821119104 00002000:00100000:0.0:1787602487.021278:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff944a6ebc6680 x1874436821119104/t0(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:323/0 lens 504/0 e 0 to 0 dl 1787602498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602487.021289:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a6ebc6680 with x1874436821119104 ext(0->12) 00010000:00010000:0.0:1787602487.021298:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 8 pid: 6692 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.021314:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 8 pid: 6692 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602487.021322:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff944a6ebc6680 00000100:00100000:0.0:1787602487.021357:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:0.0:1787602487.021367:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2361:x1874436821119104:12345-192.168.206.25@tcp:4:lfs.0 00000100:00100000:1.0:1787602487.022233:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8475:1874436838975616:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602487.022258:0:8475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787602487.105527:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00000001:00080000:1.0:1787602487.151950:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1787602487.152188:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821119104:12345-192.168.206.25@tcp:4:lfs.0 Request processed in 130817us (131996us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787602487.152210:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 0 00002000:00100000:0.0:1787602487.152224:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff944a6ebc6680 x1874436821119104/t4294967299(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:323/0 lens 504/448 e 0 to 0 dl 1787602498 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602487.152234:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a6ebc6680 with x1874436821119104 ext(0->12) 00010000:00010000:0.0:1787602487.152244:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 7 pid: 6692 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.152261:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 7 pid: 6692 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602487.152268:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff944a6ebc6680 00000100:00100000:2.0:1787602487.158629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602487.158784:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821119232 00000100:00100000:1.0:1787602487.158796:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821119232 00010000:00010000:1.0:1787602487.158850:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 7 pid: 6692 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602487.158960:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00100000:1.0:1787602487.158974:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821119232:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602487.159010:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787602487.159078:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787602487.159082:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787602485 00002000:00010000:1.0:1787602487.159085:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787602486 00002000:00010000:1.0:1787602487.159088:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787602485 00002000:00010000:1.0:1787602487.159091:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1787602487.159098:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 7 pid: 6692 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.159193:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 7 pid: 6692 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.159224:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af46bab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd8e expref: 7 pid: 6692 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.159246:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602487.159251:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602487.159258:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.159270:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.159303:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602487.159420:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821119232:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 448us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.159430:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 36 00010000:00010000:2.0:1787602487.159609:0:8475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.159620:0:8475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.159650:0:8475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.159667:0:8475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.159675:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.159682:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011cc00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602487.159687:0:8475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.159696:0:8475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.159713:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.159720:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093ef614c/0x576b7af90af46bf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602487.159781:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2362:x1874436821118976:12345-192.168.206.25@tcp:1:lfs.0 Request processed in 148839us (156435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602487.159790:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 23 00000100:00100000:2.0:1787602487.166679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602487.169864:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821119488 00000100:00100000:0.0:1787602487.169886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821119488 00000100:00100000:0.0:1787602487.169977:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:0.0:1787602487.169990:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:10302:x1874436821119488:12345-192.168.206.25@tcp:35:lfs.0 00000004:00010000:0.0:1787602487.170109:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46bea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdaa expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787602487.170470:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787602487.170537:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787602487.171343:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787602487.171422:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.171443:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd80 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.171464:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.171513:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd80 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.171534:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd80 expref: 24 pid: 5834 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602487.171563:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874436838975744:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602487.171693:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49ed8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787602487.173856:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874436838975744:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602487.173899:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602487.174534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602487.174618:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821119616 00000100:00100000:1.0:1787602487.174628:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821119616 00010000:00010000:1.0:1787602487.174676:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd80 expref: 25 pid: 5834 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602487.174719:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 37 00000100:00100000:1.0:1787602487.174731:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+25:2361:x1874436821119616:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602487.174747:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602487.174755:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd80 expref: 25 pid: 5834 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.174768:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd80 expref: 25 pid: 5834 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.174793:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46b8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd80 expref: 25 pid: 5834 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.174814:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a48947b00) 00010000:00010000:1.0:1787602487.174819:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.174828:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.174837:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.174870:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602487.174929:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:2361:x1874436821119616:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 200us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.174946:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 37 00010000:00010000:0.0:1787602487.176515:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.176534:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787602487.176712:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787602487.176983:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787602487.177147:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874436838975872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787602487.177746:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602487.177806:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49ed83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602487.177841:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838975872 00000100:00100000:2.0:1787602487.177862:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838975872 00000100:00100000:2.0:1787602487.177933:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602487.177946:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874436838975872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787602487.178098:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874436838975872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 154us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602487.178108:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602487.178190:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874436838975872:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787602487.179666:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787602487.179761:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a751b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874436838976000:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787602487.179823:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602487.179856:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49ed8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787602487.180515:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838976000 00000100:00100000:2.0:1787602487.180529:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838976000 00000100:00100000:2.0:1787602487.180657:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602487.180670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874436838976000:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787602487.181013:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874436838976000:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 345us (1188us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787602487.181022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602487.181086:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a751b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874436838976000:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787602487.181163:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787602487.181204:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.181212:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.181217:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.181221:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890de00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602487.181224:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.181229:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.181240:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a48947b00) 00010000:00010000:0.0:1787602487.181242:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787602487.181245:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602487.181248:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46bff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787602487.181791:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787602487.182021:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787602487.182033:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318287995456ns, next at 319287993666ns, rc = 0 00000001:00080000:0.0:1787602487.182066:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787602487.182108:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a48947b00) 00010000:00010000:0.0:1787602487.182112:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787602487.182119:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46bea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdaa expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602487.182391:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:10302:x1874436821119488:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 12401us (15725us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787602487.182400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 8 00000020:00080000:0.0:1787602487.182405:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787602487.185484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602487.185581:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821119744 00000100:00100000:3.0:1787602487.185592:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821119744 00000100:00100000:3.0:1787602487.185665:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:3.0:1787602487.185678:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:10302:x1874436821119744:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602487.185709:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602487.185737:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46c06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fdb1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.185810:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46c06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdb1 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.185844:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46c06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdb1 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.185867:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:3.0:1787602487.185870:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602487.185875:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71000, rc 0) 00000100:00100000:3.0:1787602487.185951:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+28:10302:x1874436821119744:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 275us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602487.185959:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:3.0:1787602487.194373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602487.194465:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821120000 00000100:00100000:2.0:1787602487.194483:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821120000 00000100:00100000:2.0:1787602487.194563:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:2.0:1787602487.194575:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a50588c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+28:10302:x1874436821120000:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:2.0:1787602487.194872:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a50588c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:10302:x1874436821120000:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 298us (523us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787602487.194881:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:0.0:1787602487.272193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602487.272636:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821120256 00000100:00100000:1.0:1787602487.272650:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821120256 00000100:00100000:1.0:1787602487.272869:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 46 00000100:00100000:1.0:1787602487.272881:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:10312:x1874436821120256:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602487.272914:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602487.272938:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fdb8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602487.273310:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787602487.273694:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdb8 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.273711:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:1.0:1787602487.273715:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602487.273720:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdb8 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.273735:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c000, rc 0) 00000100:00100000:1.0:1787602487.273850:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:10312:x1874436821120256:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 971us (1670us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787602487.273858:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 46 00000100:00100000:3.0:1787602487.280637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602487.280797:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821120384 00000100:00100000:1.0:1787602487.280810:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821120384 00000100:00100000:1.0:1787602487.280883:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00100000:1.0:1787602487.280896:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:10312:x1874436821120384:12345-192.168.206.25@tcp:34:lfs.0 00010000:00010000:1.0:1787602487.281018:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281078:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281093:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281377:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281387:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281395:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281624:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281634:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281641:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602487.281695:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281710:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281728:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281735:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281741:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602487.281746:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281753:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281767:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:1.0:1787602487.281770:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602487.281776:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281781:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281795:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281801:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281807:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281812:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602487.281821:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281827:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281834:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a43b20500) 00010000:00010000:1.0:1787602487.281837:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602487.281840:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281846:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281862:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281868:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281873:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281878:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602487.281881:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281886:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281893:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602487.281894:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602487.281904:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.281910:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602487.282112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:10312:x1874436821120384:12345-192.168.206.25@tcp:34:lfs.0 Request processed in 1207us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.282123:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00100000:3.0:1787602487.284249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602487.284969:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821120640 00000100:00100000:2.0:1787602487.284984:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821120640 00000100:00100000:2.0:1787602487.285220:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:2.0:1787602487.285232:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:10312:x1874436821120640:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:2.0:1787602487.285667:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+31:10312:x1874436821120640:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 436us (1428us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787602487.285692:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:0.0:1787602487.326186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602487.326323:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821120896 00000100:00100000:2.0:1787602487.326338:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821120896 00000100:00100000:2.0:1787602487.326665:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 48 00000100:00100000:2.0:1787602487.326679:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+31:10315:x1874436821120896:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:2.0:1787602487.326710:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602487.326736:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fdbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.326836:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46c37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.326852:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46c37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.326866:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46c37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.326881:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46c3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.326888:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.326894:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327081:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327118:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327126:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602487.327137:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787602487.327247:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46c37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327255:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46c37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327261:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46c37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327268:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602487.327273:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46c37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327281:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46c37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327296:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:2.0:1787602487.327298:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602487.327305:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46c37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327312:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46c37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327325:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327337:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46c3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327343:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327476:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602487.327482:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327489:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46c3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327498:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a48947200) 00010000:00010000:2.0:1787602487.327501:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602487.327503:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46c3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327509:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46c3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327570:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdbf expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327585:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdbf expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.327592:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:2.0:1787602487.327594:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602487.327603:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476800, rc 0) 00000100:00100000:2.0:1787602487.327682:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+33:10315:x1874436821120896:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1005us (1508us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787602487.327690:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 48 00000100:00100000:3.0:1787602487.330189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602487.330411:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821121024 00000100:00100000:1.0:1787602487.330422:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821121024 00000100:00100000:1.0:1787602487.330479:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:1.0:1787602487.330491:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+33:10315:x1874436821121024:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:1.0:1787602487.330589:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.330608:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.330619:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.330655:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.330662:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.330670:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.330676:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602487.330694:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.330703:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.330716:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602487.330719:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602487.330724:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.330731:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602487.330811:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+33:10315:x1874436821121024:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 321us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.330818:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:0.0:1787602487.332900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602487.333001:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821121280 00000100:00100000:2.0:1787602487.333014:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821121280 00000100:00100000:2.0:1787602487.333111:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:2.0:1787602487.333124:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+33:10315:x1874436821121280:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:2.0:1787602487.333392:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:10315:x1874436821121280:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 269us (502us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787602487.333401:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:0.0:1787602487.598738:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602487.598987:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821121536 00000100:00100000:3.0:1787602487.599000:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821121536 00000100:00100000:3.0:1787602487.599103:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 50 00000100:00100000:3.0:1787602487.599116:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:10346:x1874436821121536:12345-192.168.206.25@tcp:101:cat.0 00010000:00010000:3.0:1787602487.599147:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602487.599171:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46c5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fdc6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.599289:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46c61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.599305:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46c61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.599338:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46c61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602487.599351:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787602487.599759:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46c5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdc6 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.599783:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46c61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdc6 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.599792:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:3.0:1787602487.599795:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602487.599799:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71a00, rc 0) 00000100:00100000:3.0:1787602487.600724:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+36:10346:x1874436821121536:12345-192.168.206.25@tcp:101:cat.0 Request processed in 1604us (1994us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787602487.600734:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 50 00000100:00100000:3.0:1787602487.604971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602487.605028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602487.605427:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821121664 00000100:00100000:1.0:1787602487.605441:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821121664 00000100:00100000:1.0:1787602487.605535:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:1.0:1787602487.605558:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+36:2361:x1874436821121664:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602487.605578:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602487.605610:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46c61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdc6 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.605634:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602487.605640:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602487.605713:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+35:2361:x1874436821121664:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 167us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.605742:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:2.0:1787602487.607870:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821121920 00000100:00100000:2.0:1787602487.607939:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821121920 00000100:00100000:2.0:1787602487.608318:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00100000:2.0:1787602487.608332:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+35:10346:x1874436821121920:12345-192.168.206.25@tcp:35:cat.0 00000100:00100000:2.0:1787602487.608756:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+36:10346:x1874436821121920:12345-192.168.206.25@tcp:35:cat.0 Request processed in 426us (3725us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787602487.608766:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00100000:3.0:1787602487.666632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602487.666807:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821122176 00000100:00100000:1.0:1787602487.666821:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821122176 00000100:00100000:1.0:1787602487.666899:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00100000:1.0:1787602487.666913:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+36:10352:x1874436821122176:12345-192.168.206.25@tcp:101:dd.0 00010000:00010000:1.0:1787602487.666948:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602487.666953:0:9459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787602487.666984:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46bc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd9c expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.667007:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:1.0:1787602487.667013:0:9459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602487.667028:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fdcd expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.667225:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.667243:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdbf expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.667252:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.667292:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdbf expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.667307:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdbf expref: 36 pid: 5834 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602487.667341:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838976128:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602487.667464:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e6a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602487.669965:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838976128:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602487.670003:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602487.671694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602487.671780:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821122304 00000100:00100000:1.0:1787602487.671792:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821122304 00010000:00010000:1.0:1787602487.671841:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdbf expref: 37 pid: 5834 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602487.671889:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 38 00000100:00100000:1.0:1787602487.671901:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+37:2361:x1874436821122304:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602487.671918:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602487.671926:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdbf expref: 37 pid: 5834 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.671940:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdbf expref: 37 pid: 5834 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.671965:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46c45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdbf expref: 37 pid: 5834 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.671986:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602487.671991:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.672019:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.672026:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.672124:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602487.672184:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+36:2361:x1874436821122304:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 284us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.672192:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 38 00010000:00010000:3.0:1787602487.672748:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.672759:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602487.672784:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787602487.673004:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdcd expref: 37 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.673034:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdcd expref: 36 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.673077:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:3.0:1787602487.673080:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602487.673083:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d200, rc 0) 00000100:00100000:3.0:1787602487.673146:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+36:10352:x1874436821122176:12345-192.168.206.25@tcp:101:dd.0 Request processed in 6236us (6528us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787602487.673154:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00100000:3.0:1787602487.681771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602487.681884:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821122560 00000100:00100000:2.0:1787602487.681897:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821122560 00000100:00100000:2.0:1787602487.681970:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00100000:2.0:1787602487.681983:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+36:10352:x1874436821122560:12345-192.168.206.25@tcp:36:dd.0 00010000:00010000:2.0:1787602487.682376:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.682396:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.682672:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602487.682741:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787602487.682772:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f879502 reply state 00000000499b7afa transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602487.682783:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602487.682947:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+39:10352:x1874436821122560:12345-192.168.206.25@tcp:36:dd.0 Request processed in 964us (1188us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787602487.682956:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 52 00000020:00080000:2.0:1787602487.682962:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602487.692793:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.692816:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.692825:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.692833:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602487.692839:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.692847:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.692868:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:3.0:1787602487.692872:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602487.692895:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.692902:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46c84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.775588:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602487.940695:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602487.941153:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821122688 00000100:00100000:1.0:1787602487.941167:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821122688 00000100:00100000:1.0:1787602487.941251:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 53 00000100:00100000:1.0:1787602487.941264:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+38:10366:x1874436821122688:12345-192.168.206.25@tcp:101:stat.0 00010000:00010000:1.0:1787602487.941296:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602487.941320:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46c8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fdd4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941412:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941430:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941446:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941464:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941486:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941493:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941626:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941639:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdcd expref: 39 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941648:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941688:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdcd expref: 39 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602487.941717:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdcd expref: 39 pid: 9459 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602487.941734:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838976256:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602487.941865:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e6a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602487.946633:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838976256:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602487.946675:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602487.948232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602487.948577:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821122944 00000100:00100000:0.0:1787602487.948588:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821122944 00000100:00100000:0.0:1787602487.948661:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:0.0:1787602487.948673:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:5598:x1874436821122944:12345-192.168.206.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787602487.949200:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+41:5598:x1874436821122944:12345-192.168.206.25@tcp:35:ldlm_bl.0 Request processed in 527us (976us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787602487.949210:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:0.0:1787602487.953562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602487.954238:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821123072 00000100:00100000:2.0:1787602487.954254:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821123072 00010000:00010000:2.0:1787602487.954310:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdcd expref: 41 pid: 9459 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602487.954564:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:2.0:1787602487.954577:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+41:2362:x1874436821123072:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602487.954597:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602487.954607:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdcd expref: 41 pid: 9459 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.954622:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdcd expref: 41 pid: 9459 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.954649:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af46c76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdcd expref: 41 pid: 9459 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.954688:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:2.0:1787602487.954694:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.954718:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.954727:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602487.954772:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602487.954857:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:2362:x1874436821123072:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 282us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602487.954866:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 39 00010000:00010000:3.0:1787602487.954946:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.954956:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602487.955012:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787602487.955017:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602487.955084:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955108:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955119:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955125:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955136:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955143:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602487.955148:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955163:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955172:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602487.955175:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602487.955179:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955186:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46c92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955198:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955203:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955209:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955214:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602487.955217:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955222:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955229:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a43b20500) 00010000:00010000:3.0:1787602487.955232:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602487.955235:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955249:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46c99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955295:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af46c8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdd4 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955310:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdd4 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602487.955317:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:3.0:1787602487.955320:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602487.955322:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c600, rc 0) 00000100:00100000:3.0:1787602487.955369:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+39:10366:x1874436821122688:12345-192.168.206.25@tcp:101:stat.0 Request processed in 14109us (14687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602487.955377:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 53 00000100:00100000:3.0:1787602488.057247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602488.057575:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821123328 00000100:00100000:1.0:1787602488.057604:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821123328 00000100:00100000:1.0:1787602488.057694:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 54 00000100:00100000:1.0:1787602488.057709:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+39:10372:x1874436821123328:12345-192.168.206.25@tcp:36:truncate.0 00010000:00010000:1.0:1787602488.057783:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602488.057820:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46ca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdd4 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.057853:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602488.057863:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602488.058254:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.058274:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.058287:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602488.058341:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787602488.058577:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088127db0 reply state 00000000af01f629 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602488.058589:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602488.058730:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+41:10372:x1874436821123328:12345-192.168.206.25@tcp:36:truncate.0 Request processed in 1025us (1497us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787602488.058739:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 54 00000020:00080000:1.0:1787602488.058744:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1787602488.060597:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602488.065935:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.065957:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.065984:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.065991:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011cc00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602488.065997:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.066007:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.066029:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602488.066033:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602488.066064:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.066072:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46ca7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602488.216982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.217148:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821123456 00000100:00100000:0.0:1787602488.217161:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821123456 00000100:00100000:0.0:1787602488.217270:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 55 00000100:00100000:0.0:1787602488.217284:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:10386:x1874436821123456:12345-192.168.206.25@tcp:101:stat.0 00010000:00010000:0.0:1787602488.217332:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602488.217363:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46cae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fddb expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.217446:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46cb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.217463:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.217476:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.217493:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.217500:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.217507:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.218799:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.218818:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.218828:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602488.218879:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787602488.218898:0:9459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602488.218932:0:9459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.218947:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.218955:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.218962:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46cb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.218970:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46cb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.218977:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890cc00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602488.218982:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46cb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.218990:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46cb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219004:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:0.0:1787602488.219008:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602488.219014:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46cb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219021:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46cb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219077:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219096:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219102:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219108:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890ca00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602488.219112:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219119:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219128:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a48ace800) 00010000:00010000:0.0:1787602488.219131:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602488.219134:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219141:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219184:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46cae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fddb expref: 42 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219200:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fddb expref: 41 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.219208:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:0.0:1787602488.219210:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602488.219218:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890c200, rc 0) 00000100:00100000:0.0:1787602488.219302:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+41:10386:x1874436821123456:12345-192.168.206.25@tcp:101:stat.0 Request processed in 2020us (2332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602488.219312:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 55 00000100:00100000:2.0:1787602488.317353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.317457:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821123712 00000100:00100000:0.0:1787602488.317470:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821123712 00000100:00100000:0.0:1787602488.317650:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 56 00000100:00100000:0.0:1787602488.317663:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+41:10396:x1874436821123712:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602488.317690:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602488.317718:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46cca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fde2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602488.317861:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787602488.318029:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46cca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde2 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.318074:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:0.0:1787602488.318078:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602488.318084:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46cca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde2 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.318100:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890de00, rc 0) 00000100:00100000:0.0:1787602488.318215:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+42:10396:x1874436821123712:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 555us (877us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787602488.318223:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 56 00000100:00100000:2.0:1787602488.322820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.323280:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821123968 00000100:00100000:0.0:1787602488.323294:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821123968 00000100:00100000:0.0:1787602488.323586:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00100000:0.0:1787602488.323616:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+42:10396:x1874436821123968:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602488.324803:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+43:10396:x1874436821123968:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 1184us (1990us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787602488.324815:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00100000:3.0:1787602488.387669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602488.387803:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821124224 00000100:00100000:1.0:1787602488.387817:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821124224 00000100:00100000:1.0:1787602488.387894:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 57 00000100:00100000:1.0:1787602488.387907:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+43:10402:x1874436821124224:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602488.387944:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602488.387970:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46cd8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fde9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.388133:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.388151:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fddb expref: 44 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.388177:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.388217:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fddb expref: 44 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.388232:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fddb expref: 44 pid: 9459 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602488.388248:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838976384:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602488.388372:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e6a4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787602488.396026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.396161:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821124352 00000100:00100000:0.0:1787602488.396173:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821124352 00010000:00010000:0.0:1787602488.396228:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fddb expref: 45 pid: 9459 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602488.396278:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 40 00000100:00100000:0.0:1787602488.396290:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+45:2362:x1874436821124352:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602488.396308:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602488.396316:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fddb expref: 45 pid: 9459 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.396332:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fddb expref: 45 pid: 9459 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.396370:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:0.0:1787602488.396376:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.396388:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.396400:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.396445:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602488.396517:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+45:2362:x1874436821124352:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 229us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602488.396525:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 40 00010000:00010000:1.0:1787602488.397273:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46cc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fddb expref: 44 pid: 9459 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602488.397297:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838976384:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602488.397326:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.397337:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.397344:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602488.397368:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787602488.397579:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46cd8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde9 expref: 45 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.397615:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde9 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.397624:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602488.397627:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787602488.397630:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c600, rc 0) 00000100:00100000:1.0:1787602488.397737:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+44:10402:x1874436821124224:12345-192.168.206.25@tcp:101:bash.0 Request processed in 9832us (10082us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787602488.397747:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 57 00000100:00100000:2.0:1787602488.406311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602488.406405:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821124608 00000100:00100000:1.0:1787602488.406418:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821124608 00000100:00100000:1.0:1787602488.406496:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 58 00000100:00100000:1.0:1787602488.406510:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+44:10402:x1874436821124608:12345-192.168.206.25@tcp:36:bash.0 00010000:00010000:1.0:1787602488.406867:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.406891:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.406905:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602488.406963:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787602488.406992:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1120e07 reply state 00000000a8bd9e76 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602488.407003:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602488.407167:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:10402:x1874436821124608:12345-192.168.206.25@tcp:36:bash.0 Request processed in 660us (871us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787602488.407176:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 58 00000020:00080000:1.0:1787602488.407182:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602488.409088:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602488.409108:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602488.409116:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602488.409142:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ce00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602488.409148:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602488.409157:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602488.409176:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:3.0:1787602488.409180:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602488.409198:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602488.409205:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af46ced lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602488.416255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.416523:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821124736 00000100:00100000:0.0:1787602488.416573:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821124736 00000100:00100000:0.0:1787602488.416867:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 59 00000100:00100000:0.0:1787602488.416880:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+46:10402:x1874436821124736:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:0.0:1787602488.416911:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602488.416974:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46cf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fdf0 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.417125:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.417143:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde9 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.417151:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.417192:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde9 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.417208:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde9 expref: 47 pid: 5835 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602488.417225:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea7ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838976512:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602488.417345:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787602488.421285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.421442:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea7ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838976512:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602488.421478:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602488.421904:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821124864 00000100:00100000:1.0:1787602488.421916:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821124864 00010000:00010000:1.0:1787602488.421962:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde9 expref: 48 pid: 5835 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602488.422007:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 41 00000100:00100000:1.0:1787602488.422017:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+48:2362:x1874436821124864:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602488.422068:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602488.422076:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde9 expref: 48 pid: 5835 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.422090:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde9 expref: 48 pid: 5835 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.422124:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46cdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fde9 expref: 48 pid: 5835 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.422142:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602488.422147:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.422159:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.422167:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.422257:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602488.422311:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:2362:x1874436821124864:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 295us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602488.422319:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 41 00010000:00010000:3.0:1787602488.422825:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602488.422837:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602488.422898:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787602488.422903:0:9459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602488.423938:0:9459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602488.423988:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46cf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdf0 expref: 47 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602488.424009:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdf0 expref: 46 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602488.424091:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:3.0:1787602488.424095:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602488.424156:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890ca00, rc 0) 00000100:00100000:3.0:1787602488.424269:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+46:10402:x1874436821124736:12345-192.168.206.25@tcp:101:bash.0 Request processed in 7391us (8026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602488.424278:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 59 00000100:00100000:2.0:1787602488.427790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.432140:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821125120 00000100:00100000:0.0:1787602488.432159:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821125120 00000100:00100000:0.0:1787602488.432246:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:0.0:1787602488.432260:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a5058b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+46:10402:x1874436821125120:12345-192.168.206.25@tcp:35:bash.0 00000100:00100000:0.0:1787602488.432701:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a5058b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:10402:x1874436821125120:12345-192.168.206.25@tcp:35:bash.0 Request processed in 443us (4924us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787602488.432709:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:2.0:1787602488.539764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602488.539899:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821125376 00000100:00100000:1.0:1787602488.539912:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821125376 00000100:00100000:1.0:1787602488.540020:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 60 00000100:00100000:1.0:1787602488.540032:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:10412:x1874436821125376:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602488.540111:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602488.540136:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fdf7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602488.540310:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787602488.540460:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46d02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdf7 expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.540477:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:1.0:1787602488.540481:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602488.540487:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af46d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdf7 expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.540503:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c600, rc 0) 00000100:00100000:1.0:1787602488.540576:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+48:10412:x1874436821125376:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 546us (825us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787602488.540583:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 60 00000100:00100000:2.0:1787602488.542753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602488.542845:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821125504 00000100:00100000:1.0:1787602488.542870:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821125504 00000100:00100000:1.0:1787602488.542963:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 61 00000100:00100000:1.0:1787602488.542974:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+48:10412:x1874436821125504:12345-192.168.206.25@tcp:34:lfs.0 00010000:00010000:1.0:1787602488.543081:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543110:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543124:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543140:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543147:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543161:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543272:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543281:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543288:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602488.543333:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543358:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543366:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543374:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543380:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011cc00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602488.543385:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543394:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543417:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:1.0:1787602488.543420:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602488.543425:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543431:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543445:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543451:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543456:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543468:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602488.543471:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543477:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543486:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a43b20900) 00010000:00010000:1.0:1787602488.543488:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602488.543491:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543497:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543512:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543518:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543524:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543529:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602488.543531:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543546:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543563:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602488.543565:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602488.543568:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.543574:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602488.543698:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+48:10412:x1874436821125504:12345-192.168.206.25@tcp:34:lfs.0 Request processed in 724us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602488.543707:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 61 00000100:00100000:2.0:1787602488.548612:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.552463:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821125760 00000100:00100000:0.0:1787602488.552483:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821125760 00000100:00100000:0.0:1787602488.552624:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:0.0:1787602488.552636:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+48:10412:x1874436821125760:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602488.552960:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+49:10412:x1874436821125760:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 325us (4362us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787602488.552970:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:2.0:1787602488.595935:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.596029:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821126016 00000100:00100000:0.0:1787602488.596062:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821126016 00000100:00100000:0.0:1787602488.596176:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 62 00000100:00100000:0.0:1787602488.596188:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+49:10415:x1874436821126016:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602488.596222:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602488.596247:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46d25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fdfe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596368:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46d2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596385:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46d2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596506:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46d2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596527:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46d33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596535:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46d33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596552:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46d33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596704:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46d3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596713:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596720:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602488.596729:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787602488.596843:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46d2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596851:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46d2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596864:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46d2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596870:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890da00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602488.596874:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46d2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596882:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46d2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596895:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:0.0:1787602488.596898:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602488.596903:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46d2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596909:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890da00/0x576b7af90af46d2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596924:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46d33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596930:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46d33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596936:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46d33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596941:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890de00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602488.596943:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46d33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596958:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46d33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596965:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a48ace800) 00010000:00010000:0.0:1787602488.596967:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602488.596970:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46d33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.596976:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890de00/0x576b7af90af46d33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.597022:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890cc00/0x576b7af90af46d25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdfe expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.597096:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46d3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdfe expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.597105:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:0.0:1787602488.597107:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602488.597110:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5890c200, rc 0) 00000100:00100000:0.0:1787602488.597231:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:10415:x1874436821126016:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1044us (1310us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787602488.597240:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 62 00000100:00100000:3.0:1787602488.601369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.601527:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821126144 00000100:00100000:0.0:1787602488.601548:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821126144 00000100:00100000:0.0:1787602488.601612:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 63 00000100:00100000:0.0:1787602488.601624:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:10415:x1874436821126144:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:0.0:1787602488.601750:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.601771:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.601784:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.601817:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.601825:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.601832:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.601838:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602488.601843:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.601852:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.601865:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:0.0:1787602488.601869:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602488.601874:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.601881:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602488.601985:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:10415:x1874436821126144:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 362us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602488.601992:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 63 00000100:00100000:3.0:1787602488.602282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.602812:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821126272 00000100:00100000:0.0:1787602488.602820:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821126272 00000100:00100000:0.0:1787602488.602867:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:0.0:1787602488.602876:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:2362:x1874436821126272:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602488.602890:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602488.602908:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890c200/0x576b7af90af46d3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdfe expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.602921:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:0.0:1787602488.602926:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602488.602965:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:2362:x1874436821126272:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 90us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602488.602972:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:3.0:1787602488.606269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602488.606517:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821126528 00000100:00100000:2.0:1787602488.606530:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821126528 00000100:00100000:2.0:1787602488.606600:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00100000:2.0:1787602488.606612:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:10415:x1874436821126528:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:2.0:1787602488.606983:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:10415:x1874436821126528:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 372us (725us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787602488.606992:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00100000:2.0:1787602488.742426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602488.742560:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821126784 00000100:00100000:1.0:1787602488.742574:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821126784 00000100:00100000:1.0:1787602488.742649:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 64 00000100:00100000:1.0:1787602488.742661:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:10433:x1874436821126784:12345-192.168.206.25@tcp:101:cat.0 00010000:00010000:1.0:1787602488.742707:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602488.742733:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe05 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.742850:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.742868:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.742880:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602488.742892:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787602488.743107:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe05 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.743128:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe05 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.743137:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602488.743141:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787602488.743145:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c400, rc 0) 00000100:00100000:1.0:1787602488.743228:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10433:x1874436821126784:12345-192.168.206.25@tcp:101:cat.0 Request processed in 569us (816us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787602488.743236:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 64 00000100:00100000:3.0:1787602488.782919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602488.783070:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821126912 00000100:00100000:1.0:1787602488.783082:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821126912 00000100:00100000:1.0:1787602488.783153:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 65 00000100:00100000:1.0:1787602488.783166:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10434:x1874436821126912:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602488.783196:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602488.783220:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe0c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.783310:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.783327:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.783341:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602488.783607:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787602488.783611:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602488.783636:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.783669:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe0c expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.783689:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe0c expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.783699:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:1.0:1787602488.783702:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602488.783706:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011cc00, rc 0) 00000100:00100000:1.0:1787602488.783780:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10434:x1874436821126912:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 616us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602488.783788:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 65 00000100:00100000:2.0:1787602488.792954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.793106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821127296 00000100:00100000:0.0:1787602488.793120:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821127296 00000100:00100000:0.0:1787602488.793193:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00100000:0.0:1787602488.793206:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10434:x1874436821127296:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602488.793799:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10434:x1874436821127296:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 593us (856us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787602488.793808:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 18 00010000:00010000:2.0:1787602488.797354:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602488.803158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602488.803265:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821127424 00000100:00100000:1.0:1787602488.803278:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821127424 00000100:00100000:1.0:1787602488.803366:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:1.0:1787602488.803379:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10434:x1874436821127424:12345-192.168.206.25@tcp:103:lfs.0 00010000:00010000:1.0:1787602488.803411:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787602488.803443:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5890ca00/0x576b7af90af46cfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdf0 expref: 55 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.803472:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af46d56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe05 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.803510:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46c06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fdb1 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.803522:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602488.803535:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602488.803614:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:10434:x1874436821127424:12345-192.168.206.25@tcp:103:lfs.0 Request processed in 237us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602488.803622:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:2.0:1787602488.808201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602488.808265:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821127552 00000100:00100000:1.0:1787602488.808277:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821127552 00000100:00100000:1.0:1787602488.808357:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 66 00000100:00100000:1.0:1787602488.808369:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:10434:x1874436821127552:12345-192.168.206.25@tcp:58:lfs.0 00010000:00010000:1.0:1787602488.808532:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.808561:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602488.808586:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602488.809811:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602488.810027:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787602488.810966:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787602488.811786:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:10434:x1874436821127552:12345-192.168.206.25@tcp:58:lfs.0 Request processed in 3411us (3590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602488.811800:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 66 00000100:00100000:3.0:1787602488.828485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602488.828609:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821127680 00000100:00100000:0.0:1787602488.828622:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821127680 00000100:00100000:0.0:1787602488.828880:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 67 00000100:00100000:0.0:1787602488.828895:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:10436:x1874436821127680:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602488.828927:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602488.829928:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe13 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830028:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af46d80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830058:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af46d80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830072:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af46d80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830090:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46d87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830165:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830172:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830295:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830305:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830313:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602488.830666:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787602488.830672:0:9459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602488.830697:0:9459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830711:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830720:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af46d80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830727:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af46d80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830735:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af46d80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830741:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602488.830747:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af46d80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830754:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af46d80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830768:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:0.0:1787602488.830771:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602488.830777:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af46d80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830783:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af46d80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830813:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46d87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830820:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46d87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830826:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830831:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602488.830834:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46d87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830841:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46d87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830849:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a48ace800) 00010000:00010000:0.0:1787602488.830852:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602488.830855:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46d87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830861:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46d87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830901:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af46d79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe13 expref: 54 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830915:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe13 expref: 53 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602488.830932:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602488.830935:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602488.830937:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458c00, rc 0) 00000100:00100000:0.0:1787602488.831343:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10436:x1874436821127680:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 2450us (2872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602488.831366:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 67 00000040:00080000:1.0:1787602489.182492:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602489.182503:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602489.182574:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787602489.182582:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787602489.182727:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838976640:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787602489.182837:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787602489.202224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.204643:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821127808 00000100:00100000:3.0:1787602489.204661:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821127808 00000100:00100000:3.0:1787602489.204746:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:3.0:1787602489.204761:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10447:x1874436821127808:12345-192.168.206.25@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787602489.204939:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10447:x1874436821127808:12345-192.168.206.25@tcp:900:lhsmtool_posix.0 Request processed in 181us (2726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602489.204949:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:3.0:1787602489.205019:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d69f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838976640:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787602489.209420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602489.209467:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821127936 00000100:00100000:2.0:1787602489.209478:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821127936 00000100:00100000:2.0:1787602489.209554:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 68 00000100:00100000:2.0:1787602489.209568:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10447:x1874436821127936:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787602489.209613:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787602489.209749:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10447:x1874436821127936:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 184us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602489.209767:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 68 00000100:00100000:1.0:1787602489.213919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.216985:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821128064 00000100:00100000:3.0:1787602489.217004:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821128064 00000100:00100000:3.0:1787602489.217139:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 69 00000100:00100000:3.0:1787602489.217152:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10447:x1874436821128064:12345-192.168.206.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787602489.217251:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46d95 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217281:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46d95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217296:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46d95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217314:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46d9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217321:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46d9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217328:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46d9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217747:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217759:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217767:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602489.217815:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787602489.217820:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602489.217834:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217846:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46d95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217864:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46d95 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217872:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46d95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217878:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.217884:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46d95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217893:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46d95 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217906:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:3.0:1787602489.217910:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.217915:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46d95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217921:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46d95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217937:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46d9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217943:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46d9c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217949:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46d9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217955:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.217962:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46d9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217969:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46d9c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217977:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff944a4a576400) 00010000:00010000:3.0:1787602489.217979:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.217982:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46d9c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.217989:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46d9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.218005:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.218012:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.218018:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.218024:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.218028:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.218033:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.218077:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a43b20900) 00010000:00010000:3.0:1787602489.218080:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.218089:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.218230:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46da3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.218325:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10447:x1874436821128064:12345-192.168.206.25@tcp:34:lhsmtool_posix.0 Request processed in 1172us (4418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602489.218335:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 69 00000100:00100000:1.0:1787602489.229552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602489.229991:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821128320 00000100:00100000:2.0:1787602489.230003:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821128320 00000100:00100000:2.0:1787602489.230116:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 70 00000100:00100000:2.0:1787602489.230128:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10447:x1874436821128320:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602489.230157:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602489.230182:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46daa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe1a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230333:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46db1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230353:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46db1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230366:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46db1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602489.230379:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787602489.230747:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46db1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230766:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46db1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230773:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46db1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230780:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602489.230785:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46db1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230793:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46db1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230807:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a43b20900) 00010000:00010000:2.0:1787602489.230810:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602489.230815:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46db1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230834:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46db1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230887:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46daa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe1a expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230897:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:2.0:1787602489.230899:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602489.230903:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46daa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe1a expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.230912:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476000, rc 0) 00000100:00100000:2.0:1787602489.231260:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10447:x1874436821128320:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 1135us (1729us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787602489.231269:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 70 00000100:00100000:2.0:1787602489.234929:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.236618:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821128448 00000100:00100000:3.0:1787602489.236635:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821128448 00000100:00100000:3.0:1787602489.236718:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 71 00000100:00100000:3.0:1787602489.236731:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10447:x1874436821128448:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787602489.236781:0:9459:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787602489.236926:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10447:x1874436821128448:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 198us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602489.236936:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 71 00000100:00100000:2.0:1787602489.240839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.240917:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821128704 00000100:00100000:3.0:1787602489.240928:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821128704 00000100:00100000:3.0:1787602489.240995:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 72 00000100:00100000:3.0:1787602489.241007:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10447:x1874436821128704:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602489.241032:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602489.241055:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787602489.241087:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af46d6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe0c expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.241119:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602489.241125:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602489.241154:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46dbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe21 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787602489.241684:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787602489.241941:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46dc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.241957:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.241968:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.242028:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46dbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe21 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.242075:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe21 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.242084:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602489.242087:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602489.242091:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70400, rc 0) 00000100:00100000:3.0:1787602489.242156:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10447:x1874436821128704:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 1151us (1329us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787602489.242167:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 72 00000100:00100000:1.0:1787602489.246079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.248292:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821128960 00000100:00100000:3.0:1787602489.248312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821128960 00000100:00100000:3.0:1787602489.248428:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 73 00000100:00100000:3.0:1787602489.248442:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10447:x1874436821128960:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787602489.248528:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602489.248574:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46dc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe21 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248601:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602489.248616:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602489.248646:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46dd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248662:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248674:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248693:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46ddb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2c79df85 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248701:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c79df85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248709:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c79df85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248803:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248812:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46dd4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248819:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248830:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.248835:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248843:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248852:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602489.248855:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.248859:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46dd4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248866:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46dd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248875:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46ddb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c79df85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248879:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46ddb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c79df85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248885:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46ddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c79df85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248891:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.248893:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46ddb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c79df85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248898:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46ddb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c79df85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248918:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2c79df85 (ffff944a4a576000) 00010000:00010000:3.0:1787602489.248920:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.248922:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46ddb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2c79df85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.248929:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46ddb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2c79df85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.249033:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10447:x1874436821128960:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 593us (3000us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602489.249061:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 73 00000100:00100000:3.0:1787602489.251879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602489.251967:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821129088 00000100:00100000:1.0:1787602489.251980:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821129088 00000100:00100000:1.0:1787602489.252110:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 74 00000100:00100000:1.0:1787602489.252122:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10447:x1874436821129088:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602489.252148:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602489.252173:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46de2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe28 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.252234:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.252250:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.252263:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.252619:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46de2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe28 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.252651:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe28 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.252660:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a43b20700) 00010000:00010000:1.0:1787602489.252664:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787602489.252668:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011de00, rc 0) 00000100:00100000:1.0:1787602489.252747:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10447:x1874436821129088:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 626us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.252756:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 74 00000100:00100000:3.0:1787602489.260843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602489.260987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821129344 00000100:00100000:0.0:1787602489.260999:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821129344 00000100:00100000:0.0:1787602489.261088:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 75 00000100:00100000:0.0:1787602489.261107:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10447:x1874436821129344:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787602489.261221:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.261242:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.261256:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602489.261587:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787602489.261597:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320367560003ns, next at 321367557730ns, rc = 0 00000004:00010000:0.0:1787602489.261692:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce42b9d7 reply state 000000007b959fdd transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602489.261702:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602489.261808:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:10447:x1874436821129344:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 709us (978us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787602489.261825:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 75 00010000:00010000:3.0:1787602489.264791:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.264812:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.264821:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.264827:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.264833:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.264842:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.264862:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a43b20700) 00010000:00010000:3.0:1787602489.264879:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787602489.264886:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.264893:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af46df0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.266985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602489.267151:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821129472 00000100:00100000:1.0:1787602489.267163:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821129472 00000100:00100000:1.0:1787602489.267222:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 76 00000100:00100000:1.0:1787602489.267234:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:10447:x1874436821129472:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602489.267266:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602489.267289:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46df7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe2f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.267363:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46df7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe2f expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.267379:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46df7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe2f expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.267407:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a43b20700) 00010000:00010000:1.0:1787602489.267411:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787602489.267428:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d800, rc 0) 00000100:00100000:1.0:1787602489.267500:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:10447:x1874436821129472:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 267us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.267507:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 76 00000100:00100000:1.0:1787602489.273751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.274331:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821129600 00000100:00100000:3.0:1787602489.274344:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821129600 00000100:00100000:3.0:1787602489.274397:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 24 00000100:00100000:3.0:1787602489.274407:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1874436821129600:12345-192.168.206.25@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787602489.274445:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:3.0:1787602489.274491:0:6694:0:(genops.c:1385:class_connect()) connect: client a41c7236-f364-42ee-9be0-a289b3ed94f6, cookie 0x576b7af90af46dfe 00002000:00100000:3.0:1787602489.274505:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a41c7236-f364-42ee-9be0-a289b3ed94f6/ffff944a49f65800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787602489.274531:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787602489.274827:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787602489.274865:0:6694:0:(import.c:65:import_set_state_nolock()) ffff944a49f60800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602489.274960:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2360:x1874436821129600:12345-192.168.206.25@tcp:8:lhsmtool_posix.0 Request processed in 545us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602489.274969:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 24 00000100:00100000:3.0:1787602489.277307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602489.277381:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821129728 00000100:00100000:1.0:1787602489.277392:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821129728 00000100:00100000:1.0:1787602489.277478:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 25 00000100:00100000:1.0:1787602489.277491:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:0:x1874436821129728:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787602489.278199:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787602489.357456:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1787602489.357483:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00000100:00100000:1.0:1787602489.357638:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:0:x1874436821129728:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 Request processed in 80143us (80528us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787602489.357650:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 25 00000100:00100000:2.0:1787602489.366318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.370814:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821129984 00000100:00100000:3.0:1787602489.370869:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821129984 00000100:00100000:3.0:1787602489.370991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:3.0:1787602489.371005:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:10447:x1874436821129984:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787602489.371333:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:10447:x1874436821129984:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 330us (5034us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787602489.371341:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:2.0:1787602489.386246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602489.398242:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821130240 00000100:00100000:0.0:1787602489.398257:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821130240 00000100:00100000:0.0:1787602489.398929:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 77 00000100:00100000:0.0:1787602489.398941:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:10447:x1874436821130240:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787602489.399098:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:10447:x1874436821130240:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 159us (12864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602489.399107:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 77 00000100:00100000:3.0:1787602489.409307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.409347:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821130368 00000100:00100000:3.0:1787602489.410605:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821130368 00000100:00100000:3.0:1787602489.410697:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 78 00000100:00100000:3.0:1787602489.410709:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:10447:x1874436821130368:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602489.410735:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602489.410761:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe36 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.410861:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.410878:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.410891:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602489.410944:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602489.410966:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.410996:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe36 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.411015:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe36 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.411054:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a43b20700) 00010000:00010000:3.0:1787602489.411057:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787602489.411062:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71200, rc 0) 00000100:00100000:3.0:1787602489.411138:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:10447:x1874436821130368:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 431us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602489.411145:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 78 00000100:00100000:0.0:1787602489.416075:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.416658:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821130496 00000100:00100000:3.0:1787602489.416670:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821130496 00000100:00100000:3.0:1787602489.416745:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 26 00000100:00100000:3.0:1787602489.416756:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821130496:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602489.416778:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602489.416805:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af46e13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe3d expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602489.416837:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ca638, blocks: 0x1 00010000:00010000:3.0:1787602489.416858:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1787602489.416863:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602489.416874:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af46e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe3d expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.416896:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af46e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe3d expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.416911:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70400, rc 0) 00000100:00100000:3.0:1787602489.416986:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821130496:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 231us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602489.416994:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 26 00000100:00100000:0.0:1787602489.431475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602489.431516:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821130752 00000100:00100000:0.0:1787602489.431555:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821130752 00000100:00100000:0.0:1787602489.431721:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 79 00000100:00100000:0.0:1787602489.431733:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:10447:x1874436821130752:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787602489.431846:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:10447:x1874436821130752:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 114us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602489.431853:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 79 00000100:00100000:0.0:1787602489.448237:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602489.448272:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821130880 00000100:00100000:0.0:1787602489.448283:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821130880 00000100:00100000:0.0:1787602489.448379:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 27 00000100:00100000:0.0:1787602489.448390:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:10447:x1874436821130880:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602489.448413:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602489.448435:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe44 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.448489:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af46e13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe3d expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.448499:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602489.448504:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602489.448510:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.448562:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af46e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe3d expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.448577:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af46e13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe3d expref: 7 pid: 6694 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602489.448593:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1874436838976768:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602489.448704:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a468d6900 going to sleep for 11 seconds 00000001:00080000:2.0:1787602489.454279:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1787602489.454291:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:2.0:1787602489.454316:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787602489.454336:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff944a44a5f900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787602489.454341:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6bf83900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff944a44a5f3c0 00000020:00080000:2.0:1787602489.454345:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6bf83300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff944a6ea7bc00 00000001:00080000:2.0:1787602489.454414:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:2.0:1787602489.454585:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838976896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787602489.457237:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1874436838976768:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602489.457279:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.457305:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458200, rc 0) 00000100:00100000:2.0:1787602489.458854:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602489.458948:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838976896 00000100:00100000:1.0:1787602489.458958:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838976896 00000100:00100000:1.0:1787602489.459024:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787602489.459054:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874436838976896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787602489.459162:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787602489.459203:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8ca635, atime: 0x6a8ca636, ctime: 0x6a8ca635, blocks: 0xb 00010000:00010000:1.0:1787602489.459212:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da73bdbb/0x576b7af90af46e21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.459235:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1787602489.459240:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602489.459248:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da73bdbb/0x576b7af90af46e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.459267:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da73bdbb/0x576b7af90af46e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.459278:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da73bdbb/0x576b7af90af46e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.459287:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da73bdbb/0x576b7af90af46e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.459305:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787602489.459835:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:10447:x1874436821130880:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 11441us (11606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602489.459844:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 27 00000100:00100000:3.0:1787602489.460055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000020:00080000:3.0:1787602489.460266:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787602489.460397:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:3.0:1787602489.460408:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602489.460427:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838977024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787602489.460476:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602489.460517:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838977024 00000100:00100000:3.0:1787602489.460523:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838977024 00000100:00100000:3.0:1787602489.460577:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787602489.460586:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838977024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787602489.460783:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821131008 00000100:00100000:0.0:1787602489.460788:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821131008 00010000:00010000:0.0:1787602489.460813:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af46e13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe3d expref: 7 pid: 6694 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602489.460841:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 42 00000100:00100000:0.0:1787602489.460854:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821131008:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602489.460866:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602489.460881:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af46e13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe3d expref: 7 pid: 6694 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.460895:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af46e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe3d expref: 7 pid: 6694 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.460919:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af46e13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe3d expref: 7 pid: 6694 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.460934:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602489.460938:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602489.460947:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 6 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.460957:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 6 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.460988:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 6 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602489.461000:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1874436838977152:192.168.206.25@tcp:105: 00000100:00100000:0.0:1787602489.461071:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a468d6900 going to sleep for 11 seconds 00002000:00010000:3.0:1787602489.461456:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787602489.461460:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787602489.461463:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787602489.461465:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787602488 -> 1787602488 00002000:00010000:3.0:1787602489.461467:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787602489.461493:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1874436838976896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2459us (2644us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787602489.461499:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874436838977024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 915us (1022us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787602489.461501:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787602489.461505:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787602489.461521:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787602489.461524:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1787602489.461563:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a6e9a3b80/2, rc 0, transno 4294967302 00000100:00100000:3.0:1787602489.461570:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838977024:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1787602489.461607:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da73bdbb/0x576b7af90af46e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.461617:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ce00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602489.461623:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da73bdbb/0x576b7af90af46e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.461645:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da73bdbb/0x576b7af90af46e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.461658:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da73bdbb/0x576b7af90af46e21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.461666:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da73bdbb/0x576b7af90af46e21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.461683:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602489.461685:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602489.461687:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787602489.462237:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a7c484e00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787602489.462245:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838976896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787602489.465141:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1874436838977152:192.168.206.25@tcp:105: 00010000:00010000:1.0:1787602489.465178:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602489.465247:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821131008:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 4392us (5209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.465261:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 42 00000100:00100000:1.0:1787602489.466654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602489.466790:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821131136 00000100:00100000:2.0:1787602489.466801:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821131136 00002000:00100000:2.0:1787602489.466855:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff944a7c5c2d80 x1874436821131136/t0(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:325/0 lens 504/0 e 0 to 0 dl 1787602500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787602489.466867:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a7c5c2d80 with x1874436821131136 ext(0->8) 00002000:00010000:2.0:1787602489.466872:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a7c5c2d80 00000100:00100000:2.0:1787602489.466907:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:2.0:1787602489.466918:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821131136:12345-192.168.206.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787602489.471178:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2361:x1874436821131136:12345-192.168.206.25@tcp:4:lhsmtool_posix.0 Request processed in 4255us (4523us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787602489.471191:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 0 00002000:00100000:2.0:1787602489.471202:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff944a7c5c2d80 x1874436821131136/t4294967303(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:325/0 lens 504/448 e 0 to 0 dl 1787602500 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787602489.471212:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a7c5c2d80 with x1874436821131136 ext(0->8) 00002000:00010000:2.0:1787602489.471219:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a7c5c2d80 00000100:00100000:3.0:1787602489.475504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602489.475600:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821131264 00000100:00100000:1.0:1787602489.475613:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821131264 00000100:00100000:1.0:1787602489.475688:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 80 00000100:00100000:1.0:1787602489.475702:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:10447:x1874436821131264:12345-192.168.206.25@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787602489.475852:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:10447:x1874436821131264:12345-192.168.206.25@tcp:44:lhsmtool_posix.0 Request processed in 153us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.475859:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 80 00000100:00100000:2.0:1787602489.478804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602489.478879:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821131392 00000100:00100000:1.0:1787602489.478895:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821131392 00000100:00100000:1.0:1787602489.478965:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 30 00000100:00100000:1.0:1787602489.478977:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2362:x1874436821131392:12345-192.168.206.25@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787602489.515178:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1787602489.515217:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787602489.515588:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821131392:12345-192.168.206.25@tcp:16:lhsmtool_posix.0 Request processed in 36605us (36783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.515600:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 30 00000100:00100000:2.0:1787602489.524512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602489.524671:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821131648 00000100:00100000:0.0:1787602489.524691:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821131648 00000100:00100000:0.0:1787602489.524770:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 81 00000100:00100000:0.0:1787602489.524783:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:10447:x1874436821131648:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787602489.524853:0:9459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602489.524889:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46e0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe36 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.524910:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a43b20700) 00010000:00010000:0.0:1787602489.524917:0:9459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602489.524957:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.524973:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.524985:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602489.525330:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070227801 reply state 000000003d286104 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602489.525341:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602489.525472:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:10447:x1874436821131648:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 690us (972us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787602489.525480:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 81 00010000:00010000:3.0:1787602489.527073:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.527120:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.527128:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.527135:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.527141:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.527149:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.527168:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a43b20700) 00010000:00010000:3.0:1787602489.527171:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.527177:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.527184:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46e28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602489.528749:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.529076:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821131776 00000100:00100000:3.0:1787602489.529088:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821131776 00000100:00100000:3.0:1787602489.529153:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 31 00000100:00100000:3.0:1787602489.529164:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821131776:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787602489.529475:0:8475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787602489.529480:0:8475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787602487 00002000:00010000:3.0:1787602489.529483:0:8475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787602486 00002000:00010000:3.0:1787602489.529485:0:8475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787602488 -> 1787602487 00002000:00010000:3.0:1787602489.529502:0:8475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787602489.529586:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821131776:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 Request processed in 423us (848us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787602489.529595:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 31 00000100:00100000:2.0:1787602489.531856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.531943:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821132032 00000100:00100000:3.0:1787602489.531954:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821132032 00000100:00100000:3.0:1787602489.532019:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 82 00000100:00100000:3.0:1787602489.532031:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:10447:x1874436821132032:12345-192.168.206.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787602489.532153:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.532172:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe28 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.532182:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.532226:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe28 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.532242:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe28 expref: 13 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.532258:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838977280:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602489.532352:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602489.548243:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838977280:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602489.548284:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.552717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602489.553152:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821132160 00000100:00100000:1.0:1787602489.553165:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821132160 00010000:00010000:1.0:1787602489.553220:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe28 expref: 14 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602489.553266:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00100000:1.0:1787602489.553278:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:2362:x1874436821132160:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602489.553296:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602489.553304:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe28 expref: 14 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553321:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe28 expref: 14 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553384:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af46de9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe28 expref: 14 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553554:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a43b20700) 00010000:00010000:1.0:1787602489.553561:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553573:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553583:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553620:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602489.553696:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:2362:x1874436821132160:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 419us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.553704:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 43 00010000:00010000:1.0:1787602489.553741:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553749:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553784:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553792:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553799:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553817:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602489.553823:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553831:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553842:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a43b20700) 00010000:00010000:1.0:1787602489.553844:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787602489.553849:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.553855:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46e2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602489.553900:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+12:10447:x1874436821132032:12345-192.168.206.25@tcp:55:lhsmtool_posix.0 Request processed in 21872us (22056us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787602489.553909:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 82 00000100:00100000:3.0:1787602489.568638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602489.568913:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821132288 00000100:00100000:1.0:1787602489.568927:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821132288 00000100:00100000:1.0:1787602489.568995:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 32 00000100:00100000:1.0:1787602489.569007:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821132288:12345-192.168.206.25@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787602489.569087:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.569123:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.569151:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602489.569156:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602489.569161:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.569203:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.569217:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 7 pid: 8475 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602489.569235:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c5c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1874436838977408:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602489.569330:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b2d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787602489.571746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602489.572253:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821132416 00000100:00100000:2.0:1787602489.572264:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821132416 00010000:00010000:2.0:1787602489.572310:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 8 pid: 8475 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602489.572346:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 44 00000100:00100000:2.0:1787602489.572817:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2361:x1874436821132416:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602489.572835:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602489.572864:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 8 pid: 8475 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.572879:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 8 pid: 8475 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.572910:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602489.572915:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602489.572922:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.572932:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.572953:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602489.573132:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46e1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe44 expref: 8 pid: 8475 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602489.573150:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c5c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1874436838977408:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602489.573174:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.573185:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.573193:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.573227:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.573235:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.573244:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.573251:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011de00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602489.573256:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.573264:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.573277:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.573284:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c44896f0/0x576b7af90af46e36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602489.573384:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821132416:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 572us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602489.573402:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 44 00000100:00100000:1.0:1787602489.578228:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821132288:12345-192.168.206.25@tcp:1:lhsmtool_posix.0 Request processed in 9205us (9584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.578245:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 32 00000100:00100000:3.0:1787602489.584845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.584896:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821132672 00000100:00100000:3.0:1787602489.584907:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821132672 00000100:00100000:3.0:1787602489.584977:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 83 00000100:00100000:3.0:1787602489.584988:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+12:10447:x1874436821132672:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787602489.585125:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.585144:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.585157:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.585429:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.585441:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46df7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe2f expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.585449:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.585490:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46df7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe2f expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.585504:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46df7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe2f expref: 13 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.585549:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b70000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838977536:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602489.585647:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787602489.590067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602489.590347:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821132800 00000100:00100000:2.0:1787602489.590369:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821132800 00010000:00010000:2.0:1787602489.590430:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46df7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe2f expref: 14 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602489.590492:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:2.0:1787602489.590505:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:2362:x1874436821132800:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602489.590523:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602489.590531:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46df7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe2f expref: 14 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.590556:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46df7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe2f expref: 14 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.590583:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a43b20700) 00010000:00010000:2.0:1787602489.590588:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.590600:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.590608:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.590630:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602489.590689:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:2362:x1874436821132800:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 186us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602489.590697:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 45 00010000:00010000:2.0:1787602489.591268:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af46df7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe2f expref: 13 pid: 5833 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602489.591287:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b70000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838977536:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602489.591324:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.591335:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.591341:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602489.591681:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787602489.591857:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787602489.591949:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787602489.592083:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838977664:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787602489.594765:0:9459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602489.594862:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602489.602012:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838977664 00000100:00100000:1.0:1787602489.602032:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838977664 00000100:00100000:1.0:1787602489.602142:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602489.602155:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9459:x1874436838977664:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787602489.602313:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9459:x1874436838977664:12345-0@lo:1000:mdt00_003.0 Request processed in 161us (7558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.602321:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602489.602507:0:9459:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1787602489.602514:0:9459:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944a6e9a3b80, transno 4294967302 00000100:00100000:3.0:1787602489.602530:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838977664:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787602489.603153:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787602489.603257:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b71500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838977792:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787602489.603308:0:9459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602489.603346:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602489.603910:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838977792 00000100:00100000:1.0:1787602489.603920:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838977792 00000100:00100000:1.0:1787602489.603957:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602489.603966:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9459:x1874436838977792:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787602489.604222:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9459:x1874436838977792:12345-0@lo:1000:mdt00_003.0 Request processed in 256us (912us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787602489.604231:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602489.606732:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b71500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838977792:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787602489.606794:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606807:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606815:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606822:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.606827:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606835:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606854:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a43b20700) 00010000:00010000:3.0:1787602489.606857:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602489.606862:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606884:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606932:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606939:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d72 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606945:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606951:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.606954:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606960:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d72 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606968:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a43b20900) 00010000:00010000:3.0:1787602489.606971:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602489.606974:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.606980:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af46d72 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.607004:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.607019:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe13 expref: 16 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.607059:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.607174:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe13 expref: 16 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.607192:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe13 expref: 16 pid: 9459 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.607207:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838977920:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602489.607307:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787602489.612020:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838977920:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602489.612082:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.613748:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602489.615378:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821132928 00000100:00100000:1.0:1787602489.616191:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821132928 00010000:00010000:1.0:1787602489.616250:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe13 expref: 17 pid: 9459 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602489.616302:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 46 00000100:00100000:1.0:1787602489.616314:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+17:2361:x1874436821132928:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602489.616332:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602489.616341:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe13 expref: 17 pid: 9459 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.616360:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe13 expref: 17 pid: 9459 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.616419:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46d8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe13 expref: 17 pid: 9459 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.616436:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a43b20900) 00010000:00010000:1.0:1787602489.616441:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.616451:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.616460:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.616497:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602489.616578:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:2361:x1874436821132928:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 266us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.616587:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 46 00010000:00010000:0.0:1787602489.616814:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616824:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616846:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616856:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616863:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616869:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602489.616874:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616882:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616892:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602489.616896:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602489.616900:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616908:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46e4b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616921:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616927:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616933:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616944:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602489.616948:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616955:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616964:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602489.616967:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787602489.616971:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.616976:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46e3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602489.617280:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:10447:x1874436821132672:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 32292us (32447us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787602489.617291:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 83 00000020:00080000:0.0:1787602489.617295:0:9459:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787602489.618982:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602489.618993:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602489.619029:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787602489.619062:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787602489.623706:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.623781:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821133184 00000100:00100000:3.0:1787602489.623794:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821133184 00000100:00100000:3.0:1787602489.623860:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 20 00000100:00100000:3.0:1787602489.623873:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:10447:x1874436821133184:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787602489.624867:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787602489.624977:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787602489.625031:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.625322:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.625336:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.625357:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.625364:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.625371:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.625485:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787602489.625631:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+17:10447:x1874436821133184:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 1756us (1934us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787602489.625642:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 20 00000020:00080000:3.0:1787602489.625648:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787602489.628403:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602489.628421:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.628433:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71a00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602489.628439:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.628449:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.628470:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff944a4a576300) 00010000:00010000:2.0:1787602489.628482:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787602489.628487:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.628494:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.628519:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602489.628521:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602489.628523:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787602489.706209:0:12008:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602489.706222:0:12008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602489.706267:0:12008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787602489.706275:0:12008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787602489.800752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602489.800893:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821133440 00000100:00100000:0.0:1787602489.800907:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821133440 00000100:00100000:0.0:1787602489.801006:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 84 00000100:00100000:0.0:1787602489.801023:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+17:10457:x1874436821133440:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602489.801077:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602489.801220:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af46e59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.801744:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46e60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.801763:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46e60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.801778:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46e60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602489.801794:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787602489.802340:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af46e59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe4b expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.802360:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46e60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe4b expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.802371:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:0.0:1787602489.802374:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787602489.802378:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458c00, rc 0) 00000100:00100000:0.0:1787602489.803239:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:10457:x1874436821133440:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 2217us (2568us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787602489.803251:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 84 00000100:00100000:2.0:1787602489.811083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.811239:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821133568 00000100:00100000:3.0:1787602489.811252:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821133568 00000100:00100000:3.0:1787602489.811462:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 85 00000100:00100000:3.0:1787602489.811475:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:10457:x1874436821133568:12345-192.168.206.25@tcp:34:lfs.0 00010000:00010000:3.0:1787602489.811580:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.811599:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.811613:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.811630:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.811647:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.811655:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812129:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812140:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812148:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602489.812197:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812211:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812218:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812225:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812232:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.812236:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812245:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812266:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602489.812270:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.812275:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812282:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812294:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812301:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812307:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812312:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.812315:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812321:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812328:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a4a576900) 00010000:00010000:3.0:1787602489.812331:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.812334:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812340:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812368:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812373:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812379:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812383:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.812387:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812393:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812400:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576300) 00010000:00010000:3.0:1787602489.812403:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.812406:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.812412:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.812504:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:10457:x1874436821133568:12345-192.168.206.25@tcp:34:lfs.0 Request processed in 1030us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602489.812513:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 85 00010000:00010000:2.0:1787602489.823499:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602489.846615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.847636:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821133824 00000100:00100000:3.0:1787602489.847653:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821133824 00000100:00100000:3.0:1787602489.847784:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 86 00000100:00100000:3.0:1787602489.847807:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:10460:x1874436821133824:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602489.847834:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602489.847863:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe52 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.847964:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.847980:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.847993:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848010:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848018:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848026:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848444:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848453:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848460:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602489.848482:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787602489.848605:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848614:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848621:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848627:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.848632:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848640:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848654:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602489.848657:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.848663:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848669:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46e8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848681:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848688:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848706:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848712:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.848715:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848722:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848731:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a4a576300) 00010000:00010000:3.0:1787602489.848734:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.848737:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848743:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46e91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848791:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46e83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe52 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848807:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe52 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.848814:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:3.0:1787602489.848816:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602489.848819:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71a00, rc 0) 00000100:00100000:3.0:1787602489.848895:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:10460:x1874436821133824:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1091us (2294us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787602489.848915:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 86 00000100:00100000:3.0:1787602489.852702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602489.853148:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821133952 00000100:00100000:2.0:1787602489.853171:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821133952 00000100:00100000:2.0:1787602489.853246:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 87 00000100:00100000:2.0:1787602489.853260:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:10460:x1874436821133952:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:2.0:1787602489.853345:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46ea6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.853790:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.853809:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.853841:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.853848:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46ea6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.853867:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.853873:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602489.853878:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.853887:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46ea6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.853901:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:2.0:1787602489.853904:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602489.853909:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46ea6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.854161:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46ea6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602489.854248:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:10460:x1874436821133952:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 990us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602489.854257:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 87 00000100:00100000:2.0:1787602489.861423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602489.861604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821134208 00000100:00100000:0.0:1787602489.861617:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821134208 00000100:00100000:0.0:1787602489.861686:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00100000:0.0:1787602489.861698:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a50589c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:10460:x1874436821134208:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602489.862014:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a50589c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:10460:x1874436821134208:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 317us (601us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787602489.862063:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00100000:2.0:1787602489.892397:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838978176:0@lo:400:kworker.0 00000100:00100000:2.0:1787602489.892499:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602489.892586:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787602489.892595:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838978304:0@lo:400:kworker.0 00000100:00100000:2.0:1787602489.892629:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602489.892692:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838978176 00000100:00100000:2.0:1787602489.892708:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838978176 00000100:00100000:2.0:1787602489.892765:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838978304 00000100:00100000:2.0:1787602489.892770:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838978304 00000100:00100000:2.0:1787602489.892813:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787602489.892825:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838978176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602489.892971:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838978176:12345-0@lo:400:kworker.0 Request processed in 149us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602489.892979:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787602489.892998:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787602489.893005:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838978304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602489.893032:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838978304:12345-0@lo:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602489.893061:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787602489.893110:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838978304:0@lo:400:kworker.0 00000100:00100000:2.0:1787602489.893121:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838978176:0@lo:400:kworker.0 00000100:00100000:3.0:1787602489.895091:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838978048:0@lo:400:kworker.0 00000100:00100000:3.0:1787602489.895183:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602489.895242:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602489.895251:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838978432:0@lo:400:kworker.0 00000100:00100000:3.0:1787602489.895285:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787602489.895321:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602489.895465:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838978048 00000100:00100000:1.0:1787602489.895476:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838978048 00000100:00100000:1.0:1787602489.895529:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787602489.895552:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838978048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602489.895907:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838978048:12345-0@lo:400:kworker.0 Request processed in 357us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.895987:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787602489.896211:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838978048:0@lo:400:kworker.0 00000100:00100000:2.0:1787602489.896285:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838978432 00000100:00100000:2.0:1787602489.896290:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838978432 00000100:00100000:2.0:1787602489.896338:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787602489.896348:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838978432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602489.896392:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838978432:12345-0@lo:400:kworker.0 Request processed in 47us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602489.896399:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787602489.896418:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602489.896429:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838978560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602489.897096:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787602489.897138:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602489.897228:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838978560 00000100:00100000:2.0:1787602489.897235:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838978560 00000100:00100000:2.0:1787602489.897276:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787602489.897286:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874436838978560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602489.897307:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787602489.897356:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874436838978560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602489.897363:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787602489.897414:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838978560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602489.897449:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838978432:0@lo:400:kworker.0 00000100:00100000:2.0:1787602489.905390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.905557:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821134464 00000100:00100000:3.0:1787602489.905570:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821134464 00000100:00100000:3.0:1787602489.905646:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 88 00000100:00100000:3.0:1787602489.905660:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:9991:x1874436821134464:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:3.0:1787602489.905692:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602489.905718:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46ead lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe59 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.906681:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.906707:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe52 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.906718:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.906763:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe52 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.906798:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe52 expref: 23 pid: 5833 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.906816:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b70380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838978688:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602489.907307:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787602489.913505:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b70380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838978688:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602489.913557:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602489.914371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602489.914483:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821134592 00000100:00100000:1.0:1787602489.914492:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821134592 00010000:00010000:1.0:1787602489.914558:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe52 expref: 24 pid: 5833 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602489.914718:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00100000:1.0:1787602489.914730:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:2361:x1874436821134592:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602489.914749:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602489.914757:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe52 expref: 24 pid: 5833 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.914772:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe52 expref: 24 pid: 5833 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.914798:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46e98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe52 expref: 24 pid: 5833 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.914817:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:1.0:1787602489.914823:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.914834:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.914856:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602489.914888:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602489.914955:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:2361:x1874436821134592:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 227us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602489.914963:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 47 00010000:00010000:3.0:1787602489.914985:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.914996:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602489.915020:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787602489.915527:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46ead lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe59 expref: 24 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.915561:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe59 expref: 23 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.915569:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:3.0:1787602489.915572:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602489.915574:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71e00, rc 0) 00000100:00100000:3.0:1787602489.915608:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:9991:x1874436821134464:12345-192.168.206.25@tcp:101:bash.0 Request processed in 9952us (10233us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787602489.915628:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 88 00000100:00100000:2.0:1787602489.920619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602489.920700:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821134848 00000100:00100000:3.0:1787602489.920713:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821134848 00000100:00100000:3.0:1787602489.920790:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 89 00000100:00100000:3.0:1787602489.920803:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:9991:x1874436821134848:12345-192.168.206.25@tcp:36:bash.0 00010000:00010000:3.0:1787602489.921476:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.921499:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.921513:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602489.921586:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787602489.921614:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad145f7b reply state 000000007e4e8f9e transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602489.921662:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787602489.921720:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787602489.921886:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:9991:x1874436821134848:12345-192.168.206.25@tcp:36:bash.0 Request processed in 1084us (1278us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787602489.921895:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 89 00000020:00080000:3.0:1787602489.921900:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787602489.925425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602489.925466:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821134976 00000100:00100000:2.0:1787602489.925478:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821134976 00000100:00100000:2.0:1787602489.925551:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 90 00000100:00100000:2.0:1787602489.925563:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:9991:x1874436821134976:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:2.0:1787602489.925595:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602489.925620:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ec9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe60 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.925696:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe60 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.925715:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe60 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602489.925754:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:2.0:1787602489.925759:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602489.925762:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476000, rc 0) 00000100:00100000:2.0:1787602489.925822:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+28:9991:x1874436821134976:12345-192.168.206.25@tcp:101:bash.0 Request processed in 260us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602489.925831:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 90 00010000:00010000:3.0:1787602489.926137:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.926148:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.926168:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.926175:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602489.926180:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.926189:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.926202:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:3.0:1787602489.926205:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602489.926208:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602489.926214:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46ec2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602489.934008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602489.936100:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821135104 00000100:00100000:0.0:1787602489.936117:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821135104 00000100:00100000:0.0:1787602489.936197:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:0.0:1787602489.936211:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:9991:x1874436821135104:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:0.0:1787602489.936235:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602489.936262:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46ed0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe67 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602489.936294:0:8475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8ca637, atime: 0x6a8ca636, ctime: 0x6a8ca637, blocks: 0xb 00010000:00010000:0.0:1787602489.936318:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1787602489.936324:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602489.936333:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe67 expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.936354:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe67 expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602489.936369:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458200, rc 0) 00000100:00100000:0.0:1787602489.936458:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:9991:x1874436821135104:12345-192.168.206.25@tcp:101:bash.0 Request processed in 250us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602489.936465:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:2.0:1787602489.940726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602489.940900:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821135232 00000100:00100000:0.0:1787602489.940913:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821135232 00002000:00010000:0.0:1787602489.940966:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787602489.940972:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a6ea5d180 with x1874436821135232 ext(0->18446744073709551615) 00002000:00010000:0.0:1787602489.941008:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a6ea5d180. 00000100:00100000:0.0:1787602489.941174:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:0.0:1787602489.941189:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821135232:12345-192.168.206.25@tcp:10:bash.0 00002000:00010000:0.0:1787602489.941570:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787602489.941575:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787602487 -> 1787602488 00002000:00010000:0.0:1787602489.941578:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787602486 -> 1787602486 00002000:00010000:0.0:1787602489.941580:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787602487 -> 1787602488 00002000:00010000:0.0:1787602489.941583:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787602489.941662:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2362:x1874436821135232:12345-192.168.206.25@tcp:10:bash.0 Request processed in 476us (947us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787602489.941671:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 1 00002000:00010000:0.0:1787602489.941676:0:6697:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787602489.941680:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a6ea5d180 with x1874436821135232 ext(0->18446744073709551615) 00002000:00010000:0.0:1787602489.941687:0:6697:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a6ea5d180. 00000100:00100000:2.0:1787602490.008379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602490.008498:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821135360 00000100:00100000:1.0:1787602490.008511:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821135360 00000100:00100000:1.0:1787602490.008610:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 91 00000100:00100000:1.0:1787602490.008631:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:10474:x1874436821135360:12345-192.168.206.25@tcp:34:lfs.0 00010000:00010000:1.0:1787602490.008715:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46ed7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.008732:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46ed7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.008744:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46ed7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.008758:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46ede lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.008764:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.008770:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787602490.008953:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602490.009713:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.009729:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.009738:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602490.009788:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.009802:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46ed7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.009808:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46ed7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.009815:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46ed7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.009830:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602490.009836:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46ed7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.009976:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46ed7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.009992:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:2.0:1787602490.009996:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602490.010001:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46ed7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010007:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af46ed7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010021:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46ede lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010027:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46ede lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010032:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46ede lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010141:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602490.010144:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46ede lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010152:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46ede lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010173:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a43b20500) 00010000:00010000:2.0:1787602490.010176:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602490.010179:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46ede lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010185:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af46ede lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010202:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010208:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010214:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010220:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602490.010223:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010228:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010235:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:2.0:1787602490.010237:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602490.010240:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.010246:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ee5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.010365:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:10474:x1874436821135360:12345-192.168.206.25@tcp:34:lfs.0 Request processed in 1741us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.010376:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 91 00000100:00100000:2.0:1787602490.080202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.080659:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821135616 00000100:00100000:0.0:1787602490.080673:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821135616 00000100:00100000:0.0:1787602490.080816:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 92 00000100:00100000:0.0:1787602490.080831:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:10477:x1874436821135616:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602490.080858:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602490.080886:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46eec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe6e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.080980:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46ef3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.080997:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.081028:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.081439:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af46efa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.081450:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af46efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.081744:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af46efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.084365:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.084395:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.084411:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602490.084426:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787602490.086968:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.086990:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46ef3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.086999:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46ef3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.087006:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602490.087033:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46ef3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.087059:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46ef3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.087080:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:0.0:1787602490.087083:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602490.087089:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46ef3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.087097:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46ef3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.087118:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af46efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.087125:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af46efa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.087132:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af46efa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.087137:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602490.087139:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af46efa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.087143:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af46efa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.087149:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a48ace000) 00010000:00010000:0.0:1787602490.087151:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602490.087160:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af46efa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.088029:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af46efa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.088300:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af46eec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe6e expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.088319:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe6e expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.088327:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:0.0:1787602490.088330:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787602490.088333:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459800, rc 0) 00000100:00100000:0.0:1787602490.088427:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:10477:x1874436821135616:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 7597us (8240us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787602490.088437:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 92 00000100:00100000:3.0:1787602490.095437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602490.103408:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821135744 00000100:00100000:2.0:1787602490.103429:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821135744 00000100:00100000:2.0:1787602490.103987:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 93 00000100:00100000:2.0:1787602490.104002:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:10477:x1874436821135744:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:2.0:1787602490.104129:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.104150:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe59 expref: 29 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.104160:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.104324:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe59 expref: 29 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.104340:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe59 expref: 29 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.104357:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838978816:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602490.104668:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602490.107257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.107590:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838978816:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602490.107623:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.109111:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821136000 00000100:00100000:0.0:1787602490.109127:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821136000 00000100:00100000:0.0:1787602490.109860:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 22 00000100:00100000:0.0:1787602490.109877:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:5598:x1874436821136000:12345-192.168.206.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787602490.112382:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+31:5598:x1874436821136000:12345-192.168.206.25@tcp:35:ldlm_bl.0 Request processed in 2496us (5123us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787602490.112707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 22 00000100:00100000:0.0:1787602490.118979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.119238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.119264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.119327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.119369:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821136512 00000100:00100000:0.0:1787602490.119383:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821136512 00010000:00010000:0.0:1787602490.119434:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe59 expref: 31 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.119490:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 48 00000100:00100000:0.0:1787602490.119502:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+31:2362:x1874436821136512:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602490.119521:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602490.119538:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe59 expref: 31 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.119555:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe59 expref: 31 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.119590:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46eb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe59 expref: 31 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.119611:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:0.0:1787602490.119617:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.119627:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.119635:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.119662:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602490.119739:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:2362:x1874436821136512:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 239us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602490.119748:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 48 00000100:00100000:2.0:1787602490.120074:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821136384 00000100:00100000:2.0:1787602490.120087:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821136384 00000100:00100000:2.0:1787602490.120140:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 118 00000100:00100000:2.0:1787602490.120148:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821136384:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602490.120203:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821136384:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 55us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.120209:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 118 00000100:00100000:3.0:1787602490.121114:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821136256 00000100:00100000:3.0:1787602490.121123:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821136256 00000100:00100000:3.0:1787602490.121196:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 59 00000100:00100000:3.0:1787602490.121205:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821136256:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602490.121255:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821136256:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 52us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602490.121276:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 59 00010000:00010000:3.0:1787602490.121312:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.121321:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.121360:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.121368:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.121377:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.121383:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602490.121388:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.121406:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.121422:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:3.0:1787602490.121425:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787602490.121430:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.121435:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af46f0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602490.121489:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:10477:x1874436821135744:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 17491us (26067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602490.121503:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 93 00000100:00080000:0.0:1787602490.122322:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602490.122330:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602490.123235:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821136128 00000100:00100000:1.0:1787602490.123266:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821136128 00000100:00100000:1.0:1787602490.123372:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 282 00000100:00100000:1.0:1787602490.123393:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821136128:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602490.123482:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821136128:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 100us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602490.123489:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 282 00000100:00100000:0.0:1787602490.125348:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.125476:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821136768 00000100:00100000:3.0:1787602490.125487:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821136768 00000100:00100000:3.0:1787602490.125558:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 23 00000100:00100000:3.0:1787602490.125871:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:10477:x1874436821136768:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:3.0:1787602490.126335:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:10477:x1874436821136768:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 766us (996us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787602490.126345:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 23 00000100:00100000:0.0:1787602490.254188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.254393:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821137024 00000100:00100000:3.0:1787602490.254406:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821137024 00000100:00100000:3.0:1787602490.254480:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 94 00000100:00100000:3.0:1787602490.254493:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:10488:x1874436821137024:12345-192.168.206.25@tcp:101:cat.0 00010000:00010000:3.0:1787602490.254538:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602490.254826:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46f16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.254925:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.254943:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.254955:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.255507:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46f24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.256150:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.256160:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.258501:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46f2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.258540:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.258553:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602490.259610:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787602490.259795:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259806:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259814:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259820:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602490.259826:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259834:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259867:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602490.259870:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602490.259876:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259883:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259901:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259908:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46f24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259913:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259919:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602490.259922:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259927:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46f24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259934:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a4a576300) 00010000:00010000:3.0:1787602490.259937:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602490.259940:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46f24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.259945:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af46f24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.260069:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46f16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe75 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.260088:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46f2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe75 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.260096:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:3.0:1787602490.260098:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602490.260101:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70c00, rc 0) 00000100:00100000:3.0:1787602490.260207:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:10488:x1874436821137024:12345-192.168.206.25@tcp:101:cat.0 Request processed in 5715us (6041us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787602490.260217:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 94 00000100:00100000:2.0:1787602490.266536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.266659:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821137280 00000100:00100000:0.0:1787602490.266672:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821137280 00000100:00100000:0.0:1787602490.266845:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 24 00000100:00100000:0.0:1787602490.266861:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:10488:x1874436821137280:12345-192.168.206.25@tcp:35:cat.0 00000100:00100000:0.0:1787602490.267228:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+33:10488:x1874436821137280:12345-192.168.206.25@tcp:35:cat.0 Request processed in 369us (717us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787602490.269455:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 24 00000100:00100000:2.0:1787602490.299522:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.299648:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821137536 00000100:00100000:0.0:1787602490.299661:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821137536 00000100:00100000:0.0:1787602490.299745:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 95 00000100:00100000:0.0:1787602490.299766:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+33:10489:x1874436821137536:12345-192.168.206.25@tcp:36:rm.0 00010000:00010000:0.0:1787602490.299839:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787602490.299874:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46f2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe75 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.299904:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe6e expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.299918:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ec9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe60 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.299954:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a4a576900) 00010000:00010000:0.0:1787602490.299978:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602490.300005:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.300020:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.300030:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.300110:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.300117:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.300124:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.300512:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.300521:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.300537:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602490.301271:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787602490.301284:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321407246581ns, next at 322407243797ns, rc = 0 00010000:00010000:0.0:1787602490.301361:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301374:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301382:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301389:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301396:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301403:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301420:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602490.301446:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301454:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301460:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301466:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602490.301471:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301480:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301500:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a48acee00) 00010000:00010000:0.0:1787602490.301503:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787602490.301509:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301515:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301550:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301557:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301562:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301567:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602490.301570:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301577:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301586:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:0.0:1787602490.301588:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602490.301592:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f39 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.301599:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602490.301622:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5d2f0a1 reply state 00000000f3a47efd transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.301633:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602490.301745:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:10489:x1874436821137536:12345-192.168.206.25@tcp:36:rm.0 Request processed in 1977us (2234us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787602490.301755:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 95 00010000:00010000:1.0:1787602490.302550:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602490.302559:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.302568:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602490.302573:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.302581:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.302595:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff944a48acee00) 00010000:00010000:1.0:1787602490.302597:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787602490.302601:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.302608:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af46f4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.302631:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602490.302633:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602490.302635:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602490.304406:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.304426:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.304433:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.304439:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602490.304444:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.304451:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.304470:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a48ace000) 00010000:00010000:3.0:1787602490.304489:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602490.304495:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.304501:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af46f40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.365958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.367113:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821137792 00000100:00100000:0.0:1787602490.367130:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821137792 00000100:00100000:0.0:1787602490.367225:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 96 00000100:00100000:0.0:1787602490.367238:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+31:10495:x1874436821137792:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:0.0:1787602490.367271:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602490.367298:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe7c expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.367475:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.367493:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.367507:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.367703:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.367713:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.367742:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787602490.371255:0:9459:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787602490.371952:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.372264:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.372280:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.372334:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.372342:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.372349:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.372355:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602490.372361:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.372369:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.372384:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:0.0:1787602490.372608:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602490.372635:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.372642:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af46f5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602490.372661:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc20f497 reply state 00000000984260a3 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.372672:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787602490.375342:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af46f55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe7c expref: 34 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.375383:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe7c expref: 33 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.376500:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a48ace900) 00010000:00010000:0.0:1787602490.376503:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602490.376508:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459000, rc 0) 00000100:00100000:0.0:1787602490.377508:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:10495:x1874436821137792:12345-192.168.206.25@tcp:101:bash.0 Request processed in 9923us (11217us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787602490.379943:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 96 00010000:00010000:1.0:1787602490.381381:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.381637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00010000:00010000:1.0:1787602490.381738:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.381747:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.381876:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602490.381881:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.381890:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.381910:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a48ace200) 00010000:00010000:1.0:1787602490.381913:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602490.381918:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.381924:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af46f63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602490.382343:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821137920 00000100:00100000:3.0:1787602490.382812:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821137920 00000100:00100000:3.0:1787602490.382897:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 34 00000100:00100000:3.0:1787602490.382910:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821137920:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:3.0:1787602490.382933:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602490.382961:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a373b49e/0x576b7af90af46f78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe83 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602490.385110:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602490.385145:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:2.0:1787602490.385152:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602490.385183:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a373b49e/0x576b7af90af46f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe83 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.385416:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a373b49e/0x576b7af90af46f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe83 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.385436:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70800, rc 0) 00000100:00100000:2.0:1787602490.386713:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821137920:12345-192.168.206.25@tcp:101:bash.0 Request processed in 2616us (3894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.386729:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 34 00000100:00100000:2.0:1787602490.393636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.393953:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821138048 00000100:00100000:3.0:1787602490.393975:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821138048 00000100:00100000:3.0:1787602490.394136:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:3.0:1787602490.394149:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:10495:x1874436821138048:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:3.0:1787602490.394182:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602490.394206:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe8a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.394248:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a373b49e/0x576b7af90af46f78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe83 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.394258:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602490.394263:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602490.394287:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.394331:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a373b49e/0x576b7af90af46f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe83 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.394347:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a373b49e/0x576b7af90af46f78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe83 expref: 7 pid: 6692 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602490.394607:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1874436838978944:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602490.394729:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787602490.399808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.400152:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1874436838978944:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602490.400209:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.400237:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71000, rc 0) 00000100:00100000:3.0:1787602490.400313:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:10495:x1874436821138048:12345-192.168.206.25@tcp:101:bash.0 Request processed in 6166us (6690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602490.400322:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:2.0:1787602490.401131:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821138176 00000100:00100000:2.0:1787602490.401144:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821138176 00010000:00010000:2.0:1787602490.401220:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a373b49e/0x576b7af90af46f78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe83 expref: 7 pid: 6692 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.401258:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:2.0:1787602490.401267:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821138176:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602490.401286:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602490.401317:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a373b49e/0x576b7af90af46f78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe83 expref: 7 pid: 6692 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.401332:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a373b49e/0x576b7af90af46f78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe83 expref: 7 pid: 6692 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.401371:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a373b49e/0x576b7af90af46f78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe83 expref: 7 pid: 6692 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.401732:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602490.401738:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602490.401758:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.401771:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.401825:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.401857:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5819:1874436838979072:192.168.206.25@tcp:105: 00000100:00100000:2.0:1787602490.401954:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787602490.414292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.414397:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821138432 00000100:00100000:3.0:1787602490.414409:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821138432 00000100:00100000:3.0:1787602490.414480:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 25 00000100:00100000:3.0:1787602490.414493:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+33:10495:x1874436821138432:12345-192.168.206.25@tcp:35:bash.0 00000100:00100000:3.0:1787602490.414972:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:10495:x1874436821138432:12345-192.168.206.25@tcp:35:bash.0 Request processed in 472us (685us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787602490.415002:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 25 00000100:00100000:2.0:1787602490.416882:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5819:1874436838979072:192.168.206.25@tcp:105: 00010000:00010000:2.0:1787602490.416919:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602490.419198:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821138176:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 17913us (19387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.419218:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:1.0:1787602490.596029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.596162:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821138560 00000100:00100000:3.0:1787602490.596176:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821138560 00000100:00100000:3.0:1787602490.596252:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 97 00000100:00100000:3.0:1787602490.596264:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:10511:x1874436821138560:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602490.596294:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602490.596319:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe91 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.596410:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46f8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.596426:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.596439:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602490.596513:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787602490.596518:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602490.596558:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46f8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.596590:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46f86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe91 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.596611:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46f8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe91 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.596644:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602490.596647:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602490.596653:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70200, rc 0) 00000100:00100000:3.0:1787602490.596725:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+35:10511:x1874436821138560:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 462us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602490.596733:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 97 00000100:00100000:0.0:1787602490.601444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.601661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821138816 00000100:00100000:3.0:1787602490.601673:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821138816 00000100:00100000:3.0:1787602490.601750:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 98 00000100:00100000:3.0:1787602490.601763:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+35:10511:x1874436821138816:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602490.601790:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602490.601817:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46f94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe98 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.601948:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.601966:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.601978:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602490.601991:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787602490.602176:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46f94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe98 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.602222:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe98 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.602233:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a48ace900) 00010000:00010000:3.0:1787602490.602236:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602490.602240:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70400, rc 0) 00000100:00100000:3.0:1787602490.602314:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+37:10511:x1874436821138816:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 554us (884us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787602490.602322:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 98 00000100:00100000:1.0:1787602490.607329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602490.607561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.607695:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821139200 00000100:00100000:3.0:1787602490.607708:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821139200 00000100:00100000:3.0:1787602490.607790:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 99 00000100:00100000:3.0:1787602490.607803:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+37:10511:x1874436821139200:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602490.607838:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602490.607866:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fa9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fe9f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.607991:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46fb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.608008:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.608021:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602490.608034:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787602490.608234:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe9f expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.608253:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe9f expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.608262:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a48ace900) 00010000:00010000:3.0:1787602490.608265:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787602490.608268:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70800, rc 0) 00000100:00100000:3.0:1787602490.608335:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+39:10511:x1874436821139200:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 535us (774us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787602490.608342:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 99 00000100:00100000:2.0:1787602490.612486:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821138944 00000100:00100000:2.0:1787602490.612508:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821138944 00000100:00100000:2.0:1787602490.612802:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:2.0:1787602490.612817:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+39:2362:x1874436821138944:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602490.612839:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602490.612956:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af46f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe98 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.612984:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a48ace900) 00010000:00010000:2.0:1787602490.612990:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602490.613908:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+38:2362:x1874436821138944:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 1087us (6582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.616384:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:1.0:1787602490.620306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.621803:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821139328 00000100:00100000:0.0:1787602490.621817:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821139328 00000100:00100000:0.0:1787602490.622033:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00100000:0.0:1787602490.622071:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821139328:12345-192.168.206.25@tcp:1:lfs.0 00010000:00010000:0.0:1787602490.622135:0:8475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.622177:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.622187:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602490.622192:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602490.622197:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.622241:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.622257:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 6 pid: 6694 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.622274:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8475:1874436838979200:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602490.622394:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a468d6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602490.625919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.626275:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8475:1874436838979200:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602490.626309:0:8475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.626506:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821139456 00000100:00100000:2.0:1787602490.626516:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821139456 00002000:00100000:2.0:1787602490.626947:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff944a752d1f80 x1874436821139456/t0(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:326/0 lens 504/0 e 0 to 0 dl 1787602501 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787602490.626981:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a752d1f80 with x1874436821139456 ext(0->8) 00010000:00010000:2.0:1787602490.626992:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 7 pid: 6694 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.627008:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 7 pid: 6694 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602490.627017:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff944a752d1f80 00000100:00100000:2.0:1787602490.627209:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:2.0:1787602490.627221:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821139456:12345-192.168.206.25@tcp:4:lfs.0 00000100:00100000:2.0:1787602490.627937:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2362:x1874436821139456:12345-192.168.206.25@tcp:4:lfs.0 Request processed in 713us (2028us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787602490.627947:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 1 00002000:00100000:2.0:1787602490.627956:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff944a752d1f80 x1874436821139456/t4294967302(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:326/0 lens 504/448 e 0 to 0 dl 1787602501 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787602490.627966:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a752d1f80 with x1874436821139456 ext(0->8) 00010000:00010000:2.0:1787602490.627973:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 9 pid: 6694 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.627987:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 9 pid: 6694 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602490.627993:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff944a752d1f80 00000100:00100000:3.0:1787602490.631369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.632030:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821139584 00000100:00100000:0.0:1787602490.632098:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821139584 00010000:00010000:0.0:1787602490.632149:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 9 pid: 6694 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.632212:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 50 00000100:00100000:0.0:1787602490.632223:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2361:x1874436821139584:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602490.632241:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787602490.632265:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787602490.632268:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787602489 00002000:00010000:0.0:1787602490.632270:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787602489 00002000:00010000:0.0:1787602490.632272:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787602489 00010000:00010000:0.0:1787602490.632278:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 9 pid: 6694 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632292:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 9 pid: 6694 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632323:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abccb2f/0x576b7af90af46f7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe8a expref: 9 pid: 6694 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632561:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602490.632566:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602490.632574:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632586:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632623:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602490.632704:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2361:x1874436821139584:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 481us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602490.632713:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 50 00010000:00010000:0.0:1787602490.632750:0:8475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632760:0:8475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632791:0:8475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632801:0:8475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632810:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632817:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458a00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602490.632823:0:8475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632834:0:8475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632847:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.632866:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000da070e1/0x576b7af90af46fbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.632919:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821139328:12345-192.168.206.25@tcp:1:lfs.0 Request processed in 10852us (12631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602490.632928:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00100000:0.0:1787602490.636205:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.636671:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821139840 00000100:00100000:3.0:1787602490.636684:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821139840 00000100:00100000:3.0:1787602490.636753:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 26 00000100:00100000:3.0:1787602490.636765:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a5058bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+38:10511:x1874436821139840:12345-192.168.206.25@tcp:35:lfs.0 00000004:00010000:3.0:1787602490.636844:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe9f expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602490.637837:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787602490.637898:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787602490.638807:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787602490.638886:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.638911:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe7c expref: 42 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.638947:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.638995:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe7c expref: 42 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.639014:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe7c expref: 42 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602490.639031:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b70700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874436838979328:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602490.639823:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787602490.642902:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b70700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874436838979328:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602490.642944:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.644691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602490.644796:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821139968 00000100:00100000:2.0:1787602490.644828:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821139968 00010000:00010000:2.0:1787602490.644880:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe7c expref: 43 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.644927:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00100000:2.0:1787602490.644937:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+43:2362:x1874436821139968:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602490.644955:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602490.644962:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe7c expref: 43 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.644976:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe7c expref: 43 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.645002:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af46f6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe7c expref: 43 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.645023:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a48ace900) 00010000:00010000:2.0:1787602490.645030:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.645113:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.645121:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.645151:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602490.645211:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+42:2362:x1874436821139968:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 274us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.645230:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 51 00010000:00010000:1.0:1787602490.645394:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.645414:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602490.645578:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787602490.645820:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787602490.645971:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874436838979456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787602490.646031:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602490.646113:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b2de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602490.647260:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838979456 00000100:00100000:2.0:1787602490.647275:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838979456 00000100:00100000:2.0:1787602490.647368:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602490.647381:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1874436838979456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787602490.647524:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1874436838979456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 146us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.647543:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602490.647917:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874436838979456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787602490.649285:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787602490.649417:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ef94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874436838979584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787602490.649488:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602490.649541:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b2dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602490.649899:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838979584 00000100:00100000:2.0:1787602490.649909:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838979584 00000100:00100000:2.0:1787602490.649972:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787602490.649984:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1874436838979584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787602490.650231:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5837:x1874436838979584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 249us (743us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787602490.650240:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602490.650318:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ef94000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874436838979584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787602490.650401:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787602490.650452:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.650464:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.650472:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.650479:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602490.650484:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.650511:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.650651:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a48ace900) 00010000:00010000:1.0:1787602490.650655:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787602490.650661:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.650668:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af46fc5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602490.650877:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787602490.650999:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1787602490.651011:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321756973876ns, next at 322756971203ns, rc = 0 00000001:00080000:1.0:1787602490.651020:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787602490.651169:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a48ace900) 00010000:00010000:1.0:1787602490.651173:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787602490.651181:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af46fb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe9f expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602490.651364:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a5058bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+45:10511:x1874436821139840:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 14601us (15171us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787602490.651380:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 26 00000020:00080000:1.0:1787602490.651396:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787602490.659996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.660145:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821140096 00000100:00100000:3.0:1787602490.660159:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821140096 00000100:00100000:3.0:1787602490.660287:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 100 00000100:00100000:3.0:1787602490.660300:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+45:10511:x1874436821140096:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602490.660893:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602490.660929:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46fcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fea6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.661014:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fea6 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.661079:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46fcc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fea6 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.661103:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602490.661107:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602490.661112:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71200, rc 0) 00000100:00100000:3.0:1787602490.661196:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+46:10511:x1874436821140096:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 899us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602490.661205:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 100 00000100:00100000:0.0:1787602490.666688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602490.666906:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821140352 00000100:00100000:2.0:1787602490.666919:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821140352 00000100:00100000:2.0:1787602490.667053:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 27 00000100:00100000:2.0:1787602490.667069:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+46:10511:x1874436821140352:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:2.0:1787602490.667424:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:10511:x1874436821140352:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 359us (750us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787602490.667434:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 27 00000100:00100000:1.0:1787602490.755952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.756076:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821140480 00000100:00100000:3.0:1787602490.756095:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821140480 00000100:00100000:3.0:1787602490.756153:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 101 00000100:00100000:3.0:1787602490.756164:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:10521:x1874436821140480:12345-192.168.206.25@tcp:34:lfs.0 00010000:00010000:3.0:1787602490.756261:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46fd3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756281:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46fd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756293:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46fd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756308:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46fda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756315:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756357:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756695:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756704:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756712:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602490.756775:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756790:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46fd3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756797:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46fd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756805:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46fd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756811:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602490.756816:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46fd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756824:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46fd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756838:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602490.756849:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602490.756856:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46fd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756863:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af46fd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756880:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46fda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756886:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46fda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756893:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46fda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756898:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602490.756901:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46fda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756906:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46fda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756913:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a4a576a00) 00010000:00010000:3.0:1787602490.756916:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602490.756918:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46fda lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756924:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af46fda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756937:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756948:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756954:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756959:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602490.756961:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756967:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756974:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602490.756976:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602490.756978:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.756983:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af46fe1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602490.757118:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:10521:x1874436821140480:12345-192.168.206.25@tcp:34:lfs.0 Request processed in 954us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602490.757126:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 101 00000100:00100000:0.0:1787602490.790848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602490.791113:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821140736 00000100:00100000:2.0:1787602490.791127:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821140736 00000100:00100000:2.0:1787602490.791248:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 102 00000100:00100000:2.0:1787602490.791262:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:10524:x1874436821140736:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:2.0:1787602490.791310:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602490.791338:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46fe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fead expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.791432:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46fef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.791450:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.791464:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.791481:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.791488:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.791495:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792000:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792012:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792019:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602490.792030:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787602490.792193:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792202:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46fef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792209:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46fef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792216:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602490.792222:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46fef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792230:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46fef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792244:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:2.0:1787602490.792247:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602490.792252:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46fef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792258:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af46fef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792274:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792280:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792285:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792290:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602490.792300:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792307:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792314:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a48947700) 00010000:00010000:2.0:1787602490.792316:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602490.792332:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ff6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792339:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af46ff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792398:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af46fe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fead expref: 50 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792414:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fead expref: 49 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.792421:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602490.792424:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602490.792426:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476400, rc 0) 00000100:00100000:2.0:1787602490.794382:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+49:10524:x1874436821140736:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 3107us (3530us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787602490.794399:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 102 00000100:00100000:1.0:1787602490.799623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602490.799776:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821140864 00000100:00100000:0.0:1787602490.799789:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821140864 00000100:00100000:0.0:1787602490.799864:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 103 00000100:00100000:0.0:1787602490.799877:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+49:10524:x1874436821140864:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:0.0:1787602490.799968:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4700b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.799990:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4700b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.800004:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4700b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.801023:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4700b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.804636:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4700b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.804646:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4700b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.804653:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602490.804660:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4700b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.804671:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4700b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.804692:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:0.0:1787602490.804696:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602490.804702:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4700b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.804709:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4700b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.804869:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+49:10524:x1874436821140864:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 4987us (5254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602490.804883:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 103 00000100:00100000:1.0:1787602490.807512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.807681:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821141120 00000100:00100000:3.0:1787602490.807693:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821141120 00000100:00100000:3.0:1787602490.807878:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 28 00000100:00100000:3.0:1787602490.807891:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+49:10524:x1874436821141120:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:3.0:1787602490.808258:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:10524:x1874436821141120:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 368us (758us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787602490.808275:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 28 00010000:00010000:2.0:1787602490.845412:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602490.890575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.890778:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821141376 00000100:00100000:3.0:1787602490.890793:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821141376 00000100:00100000:3.0:1787602490.890869:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 104 00000100:00100000:3.0:1787602490.890909:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:10534:x1874436821141376:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:3.0:1787602490.890943:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602490.890947:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787602490.890982:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af46f8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe91 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.891008:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602490.891013:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602490.891028:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47012 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234feb4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.892342:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.892778:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fead expref: 50 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.892788:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.892839:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fead expref: 50 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.892856:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fead expref: 50 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602490.892889:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b70700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838979712:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602490.893123:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602490.899111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.900012:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b70700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838979712:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602490.900061:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.900722:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821141504 00000100:00100000:2.0:1787602490.900740:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821141504 00010000:00010000:2.0:1787602490.900790:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fead expref: 51 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.900846:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00100000:2.0:1787602490.900856:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:2361:x1874436821141504:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602490.900873:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602490.900880:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fead expref: 51 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.900894:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fead expref: 51 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.900920:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af46ffd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fead expref: 51 pid: 9459 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.900938:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602490.900943:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.900953:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.900961:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.900990:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602490.901102:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:2361:x1874436821141504:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 246us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.901109:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 52 00010000:00010000:3.0:1787602490.903324:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.903345:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602490.903377:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787602490.904021:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47012 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feb4 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.904318:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feb4 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.904332:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602490.904336:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602490.904340:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71e00, rc 0) 00000100:00100000:3.0:1787602490.904946:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:10534:x1874436821141376:12345-192.168.206.25@tcp:101:bash.0 Request processed in 14063us (14390us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787602490.904957:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 104 00000100:00100000:1.0:1787602490.911375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.911468:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821141760 00000100:00100000:3.0:1787602490.911498:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821141760 00000100:00100000:3.0:1787602490.911712:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 105 00000100:00100000:3.0:1787602490.911724:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:10534:x1874436821141760:12345-192.168.206.25@tcp:36:bash.0 00010000:00010000:3.0:1787602490.912108:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.912129:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.912270:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602490.912340:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787602490.912368:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad0bb997 reply state 00000000ea44c9e8 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602490.912378:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602490.912492:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10534:x1874436821141760:12345-192.168.206.25@tcp:36:bash.0 Request processed in 768us (1130us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787602490.912500:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 105 00000020:00080000:3.0:1787602490.912507:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602490.921266:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.921289:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.921297:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.921304:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602490.921309:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.921454:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.921476:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602490.921479:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602490.921486:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.921491:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47027 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602490.924258:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602490.924505:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821141888 00000100:00100000:2.0:1787602490.924547:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821141888 00000100:00100000:2.0:1787602490.924717:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 106 00000100:00100000:2.0:1787602490.924798:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:10534:x1874436821141888:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:2.0:1787602490.924833:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602490.924862:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4702e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234febb expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.924988:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.925005:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feb4 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.925014:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.925486:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feb4 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.925506:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feb4 expref: 53 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.925522:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838979840:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602490.926688:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602490.931395:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838979840:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602490.931436:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602490.931446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602490.931735:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821142016 00000100:00100000:3.0:1787602490.931745:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821142016 00010000:00010000:3.0:1787602490.931796:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feb4 expref: 54 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.933846:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 53 00000100:00100000:2.0:1787602490.933897:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:2362:x1874436821142016:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602490.933924:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602490.933937:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feb4 expref: 54 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.933955:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feb4 expref: 54 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.933982:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47019 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feb4 expref: 54 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.934006:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602490.934012:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.934022:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.934031:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.934113:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602490.934171:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602490.934180:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.934199:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:2362:x1874436821142016:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 315us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.934207:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 53 00000004:00200000:3.0:1787602490.934730:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787602490.934738:0:9459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602490.935140:0:9459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935189:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4702e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234febb expref: 53 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935211:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234febb expref: 52 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935219:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:1.0:1787602490.935222:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602490.935226:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476800, rc 0) 00000100:00100000:1.0:1787602490.935747:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:10534:x1874436821141888:12345-192.168.206.25@tcp:101:bash.0 Request processed in 11014us (11498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602490.935757:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 106 00000100:00100000:1.0:1787602490.944028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602490.944249:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821142272 00000100:00100000:2.0:1787602490.944263:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821142272 00000100:00100000:2.0:1787602490.944332:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 29 00000100:00100000:2.0:1787602490.944346:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:10534:x1874436821142272:12345-192.168.206.25@tcp:35:bash.0 00000100:00100000:2.0:1787602490.944740:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10534:x1874436821142272:12345-192.168.206.25@tcp:35:bash.0 Request processed in 395us (722us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787602490.944749:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 29 00000100:00100000:2.0:1787602491.005505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602491.005812:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821142400 00000100:00100000:0.0:1787602491.005827:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821142400 00000100:00100000:0.0:1787602491.005904:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 107 00000100:00100000:0.0:1787602491.005917:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:10540:x1874436821142400:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602491.005951:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602491.005998:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4703c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fec2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.006140:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47043 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.006156:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.006170:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602491.006249:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787602491.006253:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602491.006278:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.006308:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4703c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec2 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.006328:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec2 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.006338:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:0.0:1787602491.006341:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602491.006346:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458000, rc 0) 00000100:00100000:1.0:1787602491.006829:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10540:x1874436821142400:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 912us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602491.006838:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 107 00000100:00100000:1.0:1787602491.010685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.010838:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821142528 00000100:00100000:3.0:1787602491.010851:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821142528 00000100:00100000:3.0:1787602491.010926:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 108 00000100:00100000:3.0:1787602491.010938:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10540:x1874436821142528:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602491.010964:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602491.010990:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4704a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fec9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011152:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47051 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011169:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47051 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011180:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47051 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011195:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47058 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011202:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011208:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011329:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011339:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011346:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602491.011402:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787602491.011407:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602491.011428:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011453:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011463:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47051 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011469:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47051 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011476:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47051 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011482:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602491.011487:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47051 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011496:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47051 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011510:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602491.011513:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602491.011518:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47051 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011538:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47051 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011554:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011561:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47058 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011573:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011579:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602491.011582:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011588:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47058 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011596:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a4a576a00) 00010000:00010000:3.0:1787602491.011599:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602491.011601:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47058 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011607:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47058 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011644:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4704a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec9 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011657:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec9 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.011664:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602491.011666:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602491.011669:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71e00, rc 0) 00000100:00100000:3.0:1787602491.011732:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10540:x1874436821142528:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 795us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602491.011748:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 108 00000100:00100000:0.0:1787602491.016491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602491.016566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.016741:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821142912 00000100:00100000:3.0:1787602491.016755:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821142912 00000100:00100000:3.0:1787602491.016828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 109 00000100:00100000:3.0:1787602491.016840:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10540:x1874436821142912:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602491.016869:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602491.016895:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47066 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fed0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.017026:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.017078:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234febb expref: 56 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.017087:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec9 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.017096:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.017140:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec9 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.017156:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec9 expref: 56 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602491.017172:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b70700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838979968:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602491.017331:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234febb expref: 56 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.017342:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234febb expref: 56 pid: 9459 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602491.017350:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b72300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838980096:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602491.017376:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787602491.018284:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821142656 00000100:00100000:2.0:1787602491.018296:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821142656 00010000:00010000:2.0:1787602491.018333:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec9 expref: 57 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.018374:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 54 00000100:00100000:2.0:1787602491.018393:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:2361:x1874436821142656:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602491.018407:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602491.018414:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec9 expref: 57 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.018429:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec9 expref: 57 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.018453:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602491.018459:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.018467:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.018474:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602491.018698:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:2361:x1874436821142656:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 313us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602491.018721:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 54 00010000:00010000:3.0:1787602491.022362:0:5835:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.25@tcp) returned -22 from blocking AST (req@0000000029b6f2b0 x1874436838979968) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec9 expref: 56 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.022403:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4705f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec9 expref: 56 pid: 5833 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602491.022427:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b70700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838979968:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602491.022445:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b72300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838980096:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602491.022475:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602491.022482:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.022493:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.022503:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602491.023792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602491.023988:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821143040 00000100:00100000:2.0:1787602491.023999:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821143040 00010000:00010000:2.0:1787602491.024081:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234febb expref: 56 pid: 9459 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.024125:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 55 00000100:00100000:2.0:1787602491.024136:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:2362:x1874436821143040:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602491.024154:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602491.024162:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234febb expref: 56 pid: 9459 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.024176:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234febb expref: 56 pid: 9459 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.024200:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47035 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234febb expref: 56 pid: 9459 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.024217:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602491.024223:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.024232:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.024239:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.024288:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602491.024361:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:2362:x1874436821143040:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 215us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602491.024369:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 55 00010000:00010000:3.0:1787602491.025634:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.025665:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602491.025691:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787602491.025889:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47066 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed0 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.025911:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed0 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.025920:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602491.025923:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602491.025926:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71c00, rc 0) 00000100:00100000:3.0:1787602491.025982:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10540:x1874436821142912:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 9144us (9415us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787602491.025992:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 109 00000100:00100000:0.0:1787602491.029180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602491.029610:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821143296 00000100:00100000:2.0:1787602491.029624:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821143296 00000100:00100000:2.0:1787602491.029745:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:2.0:1787602491.029758:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10540:x1874436821143296:12345-192.168.206.25@tcp:103:lfs.0 00010000:00010000:2.0:1787602491.029779:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602491.029812:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af46fcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fea6 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.029836:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602491.029842:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602491.029919:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10540:x1874436821143296:12345-192.168.206.25@tcp:103:lfs.0 Request processed in 162us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602491.029926:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:0.0:1787602491.032154:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.032286:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821143424 00000100:00100000:3.0:1787602491.032299:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821143424 00000100:00100000:3.0:1787602491.032380:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 110 00000100:00100000:3.0:1787602491.032401:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10540:x1874436821143424:12345-192.168.206.25@tcp:58:lfs.0 00010000:00010000:3.0:1787602491.032774:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.032799:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.032812:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787602491.033188:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787602491.033296:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10540:x1874436821143424:12345-192.168.206.25@tcp:58:lfs.0 Request processed in 897us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602491.033305:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 110 00000100:00100000:3.0:1787602491.035868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602491.036115:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821143552 00000100:00100000:1.0:1787602491.036130:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821143552 00000100:00100000:1.0:1787602491.036194:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 111 00000100:00100000:1.0:1787602491.036205:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:10540:x1874436821143552:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602491.036251:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602491.036278:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47082 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fed7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.036660:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.036675:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47082 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed7 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.036699:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.036715:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47082 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed7 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.036732:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:1.0:1787602491.036737:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787602491.036741:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47082 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed7 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.036749:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011de00, rc 0) 00000100:00100000:1.0:1787602491.036828:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10540:x1874436821143552:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 624us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602491.036836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 111 00000100:00100000:2.0:1787602491.422268:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838980224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602491.422377:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602491.422547:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838980224 00000100:00100000:3.0:1787602491.422557:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838980224 00000100:00100000:3.0:1787602491.422640:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787602491.422652:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3311:x1874436838980224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602491.422680:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602491.422730:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3311:x1874436838980224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602491.422737:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787602491.422948:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838980224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787602491.423324:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787602491.677414:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602491.677428:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602491.677502:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787602491.677519:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787602491.677700:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838980352:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787602491.677843:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b2d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602491.685596:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838980352:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787602491.690908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602491.691719:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821143680 00000100:00100000:1.0:1787602491.691737:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821143680 00000100:00100000:1.0:1787602491.691818:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 112 00000100:00100000:1.0:1787602491.691832:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10541:x1874436821143680:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787602491.691875:0:9459:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787602491.692008:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10541:x1874436821143680:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 179us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602491.692017:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 112 00000100:00100000:2.0:1787602491.705618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.706156:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821143808 00000100:00100000:3.0:1787602491.706169:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821143808 00000100:00100000:3.0:1787602491.706247:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 113 00000100:00100000:3.0:1787602491.706261:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10541:x1874436821143808:12345-192.168.206.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787602491.706358:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47089 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.706391:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47089 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.706406:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47089 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.707913:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47090 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.707948:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47090 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.707959:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47090 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.707989:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.707998:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708004:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602491.708062:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787602491.708068:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602491.708080:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708091:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47089 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708098:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47089 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708105:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47089 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708110:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602491.708114:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47089 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708127:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47089 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708139:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:3.0:1787602491.708142:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602491.708147:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47089 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708152:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47089 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708167:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47090 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708173:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47090 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708179:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47090 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708184:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602491.708186:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47090 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708192:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47090 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708198:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff944a4a576a00) 00010000:00010000:3.0:1787602491.708201:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602491.708203:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47090 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708217:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47090 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708231:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708237:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708243:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708247:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602491.708250:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708255:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708262:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602491.708264:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602491.708267:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.708272:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47097 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602491.710202:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10541:x1874436821143808:12345-192.168.206.25@tcp:34:lhsmtool_posix.0 Request processed in 3934us (4588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602491.710216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 113 00000100:00100000:0.0:1787602491.719139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602491.719273:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821144064 00000100:00100000:1.0:1787602491.719283:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821144064 00000100:00100000:1.0:1787602491.719352:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 114 00000100:00100000:1.0:1787602491.719363:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:10541:x1874436821144064:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602491.719382:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602491.719400:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4709e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fede expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719491:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719505:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719515:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602491.719548:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787602491.719643:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719652:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719658:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719664:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602491.719668:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719676:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719687:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:1.0:1787602491.719690:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787602491.719932:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719941:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719984:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4709e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fede expref: 57 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.719994:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:1.0:1787602491.719996:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602491.720007:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4709e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fede expref: 57 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.720016:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c200, rc 0) 00000100:00100000:1.0:1787602491.720120:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:10541:x1874436821144064:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 758us (989us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787602491.720127:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 114 00000100:00100000:0.0:1787602491.724609:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602491.724686:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821144192 00000100:00100000:1.0:1787602491.724706:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821144192 00000100:00100000:1.0:1787602491.724764:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 115 00000100:00100000:1.0:1787602491.724774:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:10541:x1874436821144192:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787602491.724805:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787602491.724903:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:10541:x1874436821144192:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 130us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602491.724911:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 115 00000100:00100000:2.0:1787602491.727627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.727721:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821144448 00000100:00100000:3.0:1787602491.727730:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821144448 00000100:00100000:3.0:1787602491.727788:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 116 00000100:00100000:3.0:1787602491.727799:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:10541:x1874436821144448:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602491.727818:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602491.727821:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787602491.727848:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47043 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fec2 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.727867:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:3.0:1787602491.727872:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602491.727886:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fee5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787602491.728425:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787602491.728632:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af470ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.728646:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af470ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.728656:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af470ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.728708:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fee5 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.728725:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af470ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fee5 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.728754:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:3.0:1787602491.728757:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602491.728761:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71e00, rc 0) 00000100:00100000:3.0:1787602491.728819:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:10541:x1874436821144448:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 1021us (1199us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787602491.728827:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 116 00000100:00100000:0.0:1787602491.733717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602491.733869:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821144704 00000100:00100000:1.0:1787602491.733879:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821144704 00000100:00100000:1.0:1787602491.733935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 117 00000100:00100000:1.0:1787602491.733945:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:10541:x1874436821144704:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787602491.733996:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602491.734019:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af470ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fee5 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734068:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576a00) 00010000:00010000:1.0:1787602491.734078:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602491.734098:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734124:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734133:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734148:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4be27df8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734155:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4be27df8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734161:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4be27df8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734229:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734236:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734243:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734248:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602491.734253:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734260:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734267:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:1.0:1787602491.734275:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602491.734279:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734285:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734294:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4be27df8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734401:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4be27df8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734409:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4be27df8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734414:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602491.734417:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4be27df8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734424:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4be27df8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734432:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4be27df8 (ffff944a43b20c00) 00010000:00010000:1.0:1787602491.734435:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602491.734438:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4be27df8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.734443:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af470cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4be27df8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602491.735209:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:10541:x1874436821144704:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 1262us (1497us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602491.735226:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 117 00000100:00100000:0.0:1787602491.747107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.747232:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821144832 00000100:00100000:3.0:1787602491.747243:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821144832 00000100:00100000:3.0:1787602491.747300:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 118 00000100:00100000:3.0:1787602491.747310:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:10541:x1874436821144832:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602491.747333:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602491.747357:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234feec expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.747394:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.747406:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.747417:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.747514:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feec expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.747543:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feec expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.747559:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576300) 00010000:00010000:3.0:1787602491.747562:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787602491.747566:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70800, rc 0) 00000100:00100000:3.0:1787602491.747625:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:10541:x1874436821144832:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 317us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602491.747633:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 118 00000100:00100000:2.0:1787602491.763203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.763253:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821145088 00000100:00100000:3.0:1787602491.763263:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821145088 00000100:00100000:3.0:1787602491.763325:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 119 00000100:00100000:3.0:1787602491.763335:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:10541:x1874436821145088:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787602491.763438:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.763455:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.763467:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787602491.763715:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1787602491.763724:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322869686775ns, next at 323869684646ns, rc = 0 00000004:00010000:3.0:1787602491.763806:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e3ea849 reply state 00000000fa358fd0 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602491.763816:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602491.763913:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:10541:x1874436821145088:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 579us (718us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787602491.763934:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 119 00010000:00010000:1.0:1787602491.769662:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.769678:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.769686:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.769692:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602491.769706:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.769715:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.769731:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576300) 00010000:00010000:1.0:1787602491.769735:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787602491.769739:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.769744:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af470e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.777976:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.778220:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821145216 00000100:00100000:3.0:1787602491.778229:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821145216 00000100:00100000:3.0:1787602491.778292:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 120 00000100:00100000:3.0:1787602491.778303:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:10541:x1874436821145216:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602491.778326:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602491.778346:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fef3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.778720:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fef3 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.778736:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fef3 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.778755:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576300) 00010000:00010000:3.0:1787602491.778758:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602491.778762:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70200, rc 0) 00000100:00100000:3.0:1787602491.778825:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:10541:x1874436821145216:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 524us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602491.778832:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 120 00000100:00100000:0.0:1787602491.785347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602491.787776:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821145344 00000100:00100000:2.0:1787602491.787804:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821145344 00000100:00100000:2.0:1787602491.787885:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 37 00000100:00100000:2.0:1787602491.787898:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2361:x1874436821145344:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787602491.788351:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2361:x1874436821145344:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 Request processed in 455us (3011us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787602491.788365:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 37 00000100:00080000:0.0:1787602491.789013:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602491.801438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602491.801660:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821145600 00000100:00100000:2.0:1787602491.801670:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821145600 00000100:00100000:2.0:1787602491.801727:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 30 00000100:00100000:2.0:1787602491.801738:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:10541:x1874436821145600:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787602491.801991:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:10541:x1874436821145600:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 253us (560us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787602491.801999:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 30 00000100:00100000:1.0:1787602491.809159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.809383:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821145856 00000100:00100000:3.0:1787602491.809403:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821145856 00000100:00100000:3.0:1787602491.809651:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 121 00000100:00100000:3.0:1787602491.809663:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:10541:x1874436821145856:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787602491.809876:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:10541:x1874436821145856:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 215us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602491.809897:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 121 00000100:00100000:0.0:1787602491.814639:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602491.814738:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821145984 00000100:00100000:1.0:1787602491.814749:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821145984 00000100:00100000:1.0:1787602491.814806:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 122 00000100:00100000:1.0:1787602491.814817:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:10541:x1874436821145984:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602491.814849:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602491.814871:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fefa expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.814946:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af470f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.814961:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af470f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.814973:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af470f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602491.815013:0:9459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602491.815071:0:9459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af470f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.815112:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af470f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fefa expref: 62 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.815130:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af470f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fefa expref: 61 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.815139:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576300) 00010000:00010000:1.0:1787602491.815141:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787602491.815145:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d600, rc 0) 00000100:00100000:1.0:1787602491.815491:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:10541:x1874436821145984:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 599us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602491.815500:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 122 00000100:00100000:0.0:1787602491.830335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602491.830551:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821146112 00000100:00100000:2.0:1787602491.830561:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821146112 00000100:00100000:2.0:1787602491.830622:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 38 00000100:00100000:2.0:1787602491.830632:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2361:x1874436821146112:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602491.830649:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602491.830671:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054863cd7/0x576b7af90af47100 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff01 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602491.830696:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ca63a, blocks: 0x1 00010000:00010000:2.0:1787602491.830714:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1787602491.830718:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602491.830728:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054863cd7/0x576b7af90af47100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff01 expref: 10 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.830766:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054863cd7/0x576b7af90af47100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff01 expref: 10 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.830780:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476000, rc 0) 00000100:00100000:2.0:1787602491.831517:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:2361:x1874436821146112:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 882us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602491.831537:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 38 00000100:00100000:2.0:1787602491.839726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602491.839839:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821146368 00000100:00100000:0.0:1787602491.839850:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821146368 00000100:00100000:0.0:1787602491.839914:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 123 00000100:00100000:0.0:1787602491.839924:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:10541:x1874436821146368:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787602491.840031:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:10541:x1874436821146368:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 107us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602491.840060:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 123 00000100:00100000:2.0:1787602491.845020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602491.845139:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821146496 00000100:00100000:1.0:1787602491.845148:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821146496 00000100:00100000:1.0:1787602491.845249:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:1.0:1787602491.845259:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:10541:x1874436821146496:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602491.845276:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602491.845295:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff08 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.845328:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054863cd7/0x576b7af90af47100 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff01 expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.845337:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602491.845341:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602491.845347:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.845406:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054863cd7/0x576b7af90af47100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff01 expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.845419:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054863cd7/0x576b7af90af47100 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff01 expref: 11 pid: 6692 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602491.845431:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1874436838980480:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602491.845534:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602491.849212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602491.849284:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821146624 00000100:00100000:0.0:1787602491.849295:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821146624 00010000:00010000:0.0:1787602491.849334:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054863cd7/0x576b7af90af47100 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff01 expref: 12 pid: 6692 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602491.849387:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 56 00000100:00100000:0.0:1787602491.849404:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+12:2362:x1874436821146624:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602491.849418:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602491.849440:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054863cd7/0x576b7af90af47100 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff01 expref: 12 pid: 6692 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.849465:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054863cd7/0x576b7af90af47100 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff01 expref: 12 pid: 6692 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.849489:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602491.849493:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602491.849500:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.849510:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.849557:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602491.849572:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7509f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5818:1874436838980608:192.168.206.25@tcp:105: 00000100:00100000:0.0:1787602491.849657:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a468d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787602491.852311:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7509f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5818:1874436838980608:192.168.206.25@tcp:105: 00010000:00010000:0.0:1787602491.852337:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602491.852414:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+12:2362:x1874436821146624:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 3018us (3210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602491.852425:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 56 00010000:00010000:1.0:1787602491.853920:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054863cd7/0x576b7af90af47100 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff01 expref: 11 pid: 6692 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602491.853962:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1874436838980480:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602491.853991:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.854007:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c200, rc 0) 00000100:00100000:1.0:1787602491.854114:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:10541:x1874436821146496:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 8855us (9102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602491.854123:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:2.0:1787602491.857345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602491.858071:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821146752 00000100:00100000:0.0:1787602491.858090:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821146752 00002000:00100000:0.0:1787602491.858141:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff944a7c52f800 x1874436821146752/t0(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:327/0 lens 504/0 e 0 to 0 dl 1787602502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602491.858165:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a7c52f800 with x1874436821146752 ext(0->12) 00002000:00010000:0.0:1787602491.858171:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a7c52f800 00000100:00100000:0.0:1787602491.858201:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:0.0:1787602491.858211:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:2361:x1874436821146752:12345-192.168.206.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787602491.859118:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+12:2361:x1874436821146752:12345-192.168.206.25@tcp:4:lhsmtool_posix.0 Request processed in 903us (1776us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787602491.859128:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 2 00002000:00100000:0.0:1787602491.859136:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff944a7c52f800 x1874436821146752/t4294967308(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:327/0 lens 504/448 e 0 to 0 dl 1787602502 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602491.859145:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a7c52f800 with x1874436821146752 ext(0->12) 00002000:00010000:0.0:1787602491.859149:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a7c52f800 00000100:00100000:2.0:1787602491.862369:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.862552:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821146880 00000100:00100000:3.0:1787602491.862562:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821146880 00000100:00100000:3.0:1787602491.862655:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 124 00000100:00100000:3.0:1787602491.862666:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:10541:x1874436821146880:12345-192.168.206.25@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787602491.870012:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787602491.899733:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967376 is committed 00000004:00080000:0.0:1787602491.899751:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:0.0:1787602491.899785:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:0.0:1787602491.899792:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787602491.899809:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff944a47b2de40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787602491.899814:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6e9dae00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff944a47b2d3c0 00000020:00080000:0.0:1787602491.899817:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6e9da000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff944a6ea79400 00000001:00080000:0.0:1787602491.899831:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787602491.899849:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787602491.899892:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff944a6e4e1c00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787602491.899895:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a42e29a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff944a6e4e1d80 00000020:00080000:0.0:1787602491.899897:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a42e29500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff944a7c426c00 00000020:00080000:0.0:1787602491.899917:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787602491.900029:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787602491.900299:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787602491.900318:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7509f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838980736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787602491.900630:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602491.900708:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838980736 00000100:00100000:0.0:1787602491.900715:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838980736 00000100:00100000:0.0:1787602491.900757:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787602491.900768:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3312:x1874436838980736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787602491.900793:0:8475:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1787602491.900825:0:8475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8ca639, atime: 0x6a8ca639, ctime: 0x6a8ca639, blocks: 0x1 00010000:00010000:0.0:1787602491.900834:0:8475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af4710e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.900850:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1787602491.900854:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602491.900860:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af4710e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.900876:0:8475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af4710e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.900886:0:8475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af4710e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.900894:0:8475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af4710e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.900926:0:8475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787602491.901509:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838980864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787602491.901562:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602491.901603:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602491.901609:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838980992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787602491.901634:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602491.901663:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838980864 00000100:00100000:2.0:1787602491.901667:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838980864 00000100:00100000:2.0:1787602491.901699:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838980992 00000100:00100000:2.0:1787602491.901702:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838980992 00000100:00100000:2.0:1787602491.901715:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787602491.901720:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874436838980864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787602491.901737:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787602491.901753:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.901778:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe67 expref: 11 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.901787:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787602491.901790:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602491.901794:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.901822:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe67 expref: 11 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.901836:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe67 expref: 11 pid: 8475 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.901847:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1874436838981120:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602491.901906:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b16c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787602491.903984:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602491.903998:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af4710e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.904010:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602491.904014:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af4710e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.904024:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af4710e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.904059:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af4710e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.904067:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af4710e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.904179:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602491.904182:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602491.904184:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602491.905971:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3312:x1874436838980736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5198us (5335us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787602491.905982:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787602491.906009:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787602491.906019:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ecd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1874436838980992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787602491.906247:0:8475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787602491.906251:0:8475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787602490 00002000:00010000:0.0:1787602491.906253:0:8475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787602491.906256:0:8475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787602490 -> 1787602490 00002000:00010000:0.0:1787602491.906258:0:8475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787602491.906296:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ecd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1874436838980992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 280us (4660us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787602491.906302:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787602491.906322:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787602491.906370:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a7c656680/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787602491.906383:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838980992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787602491.906559:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:10541:x1874436821146880:12345-192.168.206.25@tcp:44:lhsmtool_posix.0 Request processed in 43893us (44195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602491.906567:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 124 00000100:00100000:3.0:1787602491.906644:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1874436838981120:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602491.906665:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602491.906802:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a7509f480/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787602491.906808:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7509f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838980736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787602491.906962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602491.907027:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821147008 00000100:00100000:2.0:1787602491.907033:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821147008 00010000:00010000:2.0:1787602491.907155:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe67 expref: 12 pid: 8475 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.907183:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 57 00000100:00100000:2.0:1787602491.907192:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+12:2362:x1874436821147008:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602491.907203:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602491.907219:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46ed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe67 expref: 12 pid: 8475 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.907232:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe67 expref: 12 pid: 8475 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.907254:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b43a450/0x576b7af90af46ed0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe67 expref: 12 pid: 8475 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.907270:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602491.907274:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602491.907279:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.907288:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.907318:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602491.907344:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+11:2362:x1874436821147008:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 154us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602491.907363:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 57 00010000:00010000:0.0:1787602491.907582:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.907603:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.907613:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.907630:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.907721:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787602491.908225:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3313:x1874436838980864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6502us (6660us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787602491.908232:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1787602491.908251:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602491.908257:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.908265:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602491.908269:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.908284:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.908296:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.908302:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8d3f0a1/0x576b7af90af47115 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.908317:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602491.908319:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602491.908321:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787602491.908714:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a6e48d880/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787602491.908721:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838980864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787602491.911513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602491.911637:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821147136 00000100:00100000:1.0:1787602491.911647:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821147136 00000100:00100000:1.0:1787602491.911733:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00100000:1.0:1787602491.911745:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+11:2363:x1874436821147136:12345-192.168.206.25@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787602491.942905:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1787602491.942922:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1787602491.943108:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821147136:12345-192.168.206.25@tcp:16:lhsmtool_posix.0 Request processed in 31360us (31599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602491.943119:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00100000:3.0:1787602491.945799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602491.945905:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821147392 00000100:00100000:0.0:1787602491.945915:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821147392 00000100:00100000:0.0:1787602491.945974:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 125 00000100:00100000:0.0:1787602491.945985:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:10541:x1874436821147392:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787602491.946068:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602491.946096:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af470f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fefa expref: 15 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.946116:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576300) 00010000:00010000:0.0:1787602491.946121:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602491.946146:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.946159:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.946167:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602491.946541:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029b6f2b0 reply state 0000000004eb8e77 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602491.946551:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602491.946643:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:10541:x1874436821147392:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 659us (851us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787602491.946650:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 125 00010000:00010000:1.0:1787602491.949005:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.949020:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.949027:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.949033:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602491.949062:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.949096:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.949114:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576300) 00010000:00010000:1.0:1787602491.949117:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602491.949122:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.949128:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af4711c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602491.950281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602491.950931:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821147520 00000100:00100000:0.0:1787602491.950941:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821147520 00000100:00100000:1.0:1787602491.951203:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 44 00000100:00100000:1.0:1787602491.951214:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821147520:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787602491.951474:0:8475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787602491.951479:0:8475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787602490 -> 1787602489 00002000:00010000:1.0:1787602491.951481:0:8475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787602489 00002000:00010000:1.0:1787602491.951483:0:8475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787602490 -> 1787602489 00002000:00010000:1.0:1787602491.951486:0:8475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787602491.951601:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821147520:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 Request processed in 388us (1324us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787602491.951608:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 44 00000100:00100000:0.0:1787602491.954291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602491.954462:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821147776 00000100:00100000:1.0:1787602491.954471:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821147776 00000100:00100000:1.0:1787602491.954536:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 126 00000100:00100000:1.0:1787602491.954547:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:10541:x1874436821147776:12345-192.168.206.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787602491.954608:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.954636:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feec expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.954646:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.954682:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feec expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.954695:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feec expref: 15 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602491.954709:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c655880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838981248:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602491.954798:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48c97f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602491.958346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602491.958552:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c655880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838981248:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602491.958579:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.958779:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821147904 00000100:00100000:2.0:1787602491.958787:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821147904 00010000:00010000:2.0:1787602491.958821:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feec expref: 16 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.958860:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 58 00000100:00100000:2.0:1787602491.958871:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:2362:x1874436821147904:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602491.958884:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602491.958891:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feec expref: 16 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.958903:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feec expref: 16 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.958944:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af470dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234feec expref: 16 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.958959:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576300) 00010000:00010000:2.0:1787602491.958963:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.958972:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.958979:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.959008:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602491.959195:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.959202:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.959228:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.959235:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.959248:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.959254:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602491.959258:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.959266:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.959276:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576300) 00010000:00010000:1.0:1787602491.959279:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787602491.959282:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.959288:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47123 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602491.959345:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:10541:x1874436821147776:12345-192.168.206.25@tcp:55:lhsmtool_posix.0 Request processed in 4799us (5060us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787602491.959364:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 126 00000100:00100000:2.0:1787602491.959885:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:2362:x1874436821147904:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 1014us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602491.959893:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 58 00000100:00100000:3.0:1787602491.962510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602491.962588:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821148032 00000100:00100000:2.0:1787602491.962597:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821148032 00000100:00100000:2.0:1787602491.962650:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:2.0:1787602491.962658:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821148032:12345-192.168.206.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787602491.962699:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.962719:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.962743:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787602491.962747:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602491.962752:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.962786:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.962800:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 7 pid: 6693 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.962813:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1874436838981376:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602491.962898:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602491.965947:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1874436838981376:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602491.965977:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602491.966265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602491.966454:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821148160 00000100:00100000:0.0:1787602491.966461:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821148160 00010000:00010000:0.0:1787602491.966495:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 8 pid: 6693 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602491.966543:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 59 00000100:00100000:0.0:1787602491.966552:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2361:x1874436821148160:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602491.966567:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602491.966588:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 8 pid: 6693 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.966601:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 8 pid: 6693 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.966622:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af47107 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff08 expref: 8 pid: 6693 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.966653:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602491.966658:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602491.966663:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.966673:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.966741:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602491.966790:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821148160:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 238us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602491.966797:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 59 00010000:00010000:1.0:1787602491.968626:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.968643:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.968674:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.968695:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.968703:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.968711:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602491.968716:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.968725:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.968740:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.968748:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae1bdb54/0x576b7af90af4712a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602491.968985:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821148032:12345-192.168.206.25@tcp:1:lhsmtool_posix.0 Request processed in 6324us (6480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602491.968995:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:0.0:1787602491.971790:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602491.971895:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821148416 00000100:00100000:2.0:1787602491.971904:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821148416 00000100:00100000:2.0:1787602491.971989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 127 00000100:00100000:2.0:1787602491.971999:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:10541:x1874436821148416:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787602491.972112:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47131 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.972146:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47131 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.972156:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47131 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.972345:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.972373:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fef3 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.972391:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.972424:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fef3 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.972437:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fef3 expref: 15 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.972450:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838981504:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602491.972540:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602491.975968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602491.976074:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821148544 00000100:00100000:3.0:1787602491.976090:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821148544 00010000:00010000:3.0:1787602491.976128:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470eb lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fef3 expref: 16 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602491.976159:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 60 00000100:00100000:3.0:1787602491.976168:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:2362:x1874436821148544:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602491.976182:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602491.976200:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470eb lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fef3 expref: 16 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.976214:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fef3 expref: 16 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.976234:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576300) 00010000:00010000:3.0:1787602491.976239:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.976248:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.976255:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602491.976271:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602491.976322:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+16:2362:x1874436821148544:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 154us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602491.976330:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 60 00010000:00010000:2.0:1787602491.976799:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af470eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fef3 expref: 15 pid: 5833 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.976816:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838981504:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602491.976839:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.976855:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.976861:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602491.977023:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787602491.977299:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787602491.977343:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787602491.977430:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874436838981632:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787602491.977483:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602491.977511:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787602491.977646:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838981632 00000100:00100000:3.0:1787602491.977652:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838981632 00000100:00100000:3.0:1787602491.977690:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602491.977699:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874436838981632:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787602491.977778:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874436838981632:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602491.977786:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602491.977856:0:5835:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787602491.977863:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1787602491.977878:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944a7c656680, transno 4294967309 00000004:00080000:0.0:1787602491.977892:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944a6e48d880, transno 4294967310 00000100:00100000:0.0:1787602491.977898:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874436838981632:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787602491.978375:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787602491.978435:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7509d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874436838981760:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787602491.978470:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602491.978489:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a468d6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787602491.979250:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838981760 00000100:00100000:3.0:1787602491.979256:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838981760 00000100:00100000:3.0:1787602491.979283:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787602491.979297:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874436838981760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787602491.979476:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1874436838981760:12345-0@lo:1000:mdt00_002.0 Request processed in 180us (1005us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787602491.979483:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787602491.979960:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7509d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1874436838981760:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787602491.979993:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980009:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980016:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980022:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602491.980026:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980033:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980793:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a4a576300) 00010000:00010000:0.0:1787602491.980798:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602491.980805:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980811:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47138 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980841:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980847:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980852:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980857:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602491.980868:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980875:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980884:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:0.0:1787602491.980886:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602491.980893:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47082 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980903:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47082 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980912:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47082 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.980947:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47082 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602491.980960:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7509dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838981888:192.168.206.25@tcp:105: 00000100:00100000:0.0:1787602491.981072:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a468d6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787602491.984127:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7509dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838981888:192.168.206.25@tcp:105: 00010000:00010000:2.0:1787602491.984156:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984165:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4707b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984197:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4713f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984210:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4713f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984221:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4713f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984231:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4713f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984257:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4713f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984264:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4713f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984271:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602491.984276:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4713f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984283:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4713f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984296:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602491.984299:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602491.984303:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4713f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984309:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4713f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984320:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47131 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984326:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47131 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984332:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47131 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984337:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602491.984347:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47131 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984355:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47131 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984363:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602491.984365:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787602491.984368:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47131 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602491.984383:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47131 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602491.984599:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+18:10541:x1874436821148416:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 12600us (12814us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787602491.984608:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 127 00000020:00080000:2.0:1787602491.984613:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787602491.985333:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602491.985339:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602491.985831:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787602491.985850:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787602491.988796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602491.988843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602491.988925:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821148800 00000100:00100000:0.0:1787602491.988934:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821148800 00000100:00100000:0.0:1787602491.988969:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821148928 00000100:00100000:0.0:1787602491.988972:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821148928 00000100:00100000:0.0:1787602491.988986:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 31 00000100:00100000:0.0:1787602491.988994:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:10541:x1874436821148800:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787602491.989730:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787602491.989830:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787602491.989871:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.989886:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.989897:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.989905:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.989912:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.989918:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602491.989930:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787602491.990020:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:10541:x1874436821148800:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 1025us (1232us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787602491.990029:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 31 00000020:00080000:0.0:1787602491.990033:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787602491.990077:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 32 00000100:00100000:0.0:1787602491.990085:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a50588050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:10540:x1874436821148928:12345-192.168.206.25@tcp:49:lfs.0 00000100:00100000:0.0:1787602491.990140:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a50588050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:10540:x1874436821148928:12345-192.168.206.25@tcp:49:lfs.0 Request processed in 56us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602491.990146:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 32 00010000:00010000:1.0:1787602491.991212:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602491.991223:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.991231:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602491.991236:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.991244:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.991260:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff944a48acec00) 00010000:00010000:1.0:1787602491.991263:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787602491.991268:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.991273:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47146 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.991291:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602491.991293:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602491.991294:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602491.994513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602491.994621:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821149184 00000100:00100000:2.0:1787602491.994632:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821149184 00000100:00100000:2.0:1787602491.994684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 128 00000100:00100000:2.0:1787602491.994695:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:10540:x1874436821149184:12345-192.168.206.25@tcp:58:lfs.0 00000040:00080000:2.0:1787602491.994942:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787602491.995028:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:10540:x1874436821149184:12345-192.168.206.25@tcp:58:lfs.0 Request processed in 334us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602491.995070:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 128 00000100:00100000:2.0:1787602492.032097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602492.032187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821149312 00000100:00100000:1.0:1787602492.032196:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821149312 00000100:00100000:1.0:1787602492.032259:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 129 00000100:00100000:1.0:1787602492.032269:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:10543:x1874436821149312:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602492.032289:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602492.032309:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af4714d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff0f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032416:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47154 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032431:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032442:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032457:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4715b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032464:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4715b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032472:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4715b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032772:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032783:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed0 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032791:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032823:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed0 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.032848:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed0 expref: 21 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602492.032862:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c655880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838982016:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602492.032962:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48c97f00 going to sleep for 11 seconds 00000100:00080000:0.0:1787602492.035112:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602492.036307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602492.036609:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821149568 00000100:00100000:2.0:1787602492.036627:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821149568 00000100:00100000:2.0:1787602492.036676:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:2.0:1787602492.036686:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:5598:x1874436821149568:12345-192.168.206.25@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787602492.036928:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:5598:x1874436821149568:12345-192.168.206.25@tcp:35:ldlm_bl.0 Request processed in 242us (626us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787602492.036936:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:1.0:1787602492.038094:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c655880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838982016:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602492.038121:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602492.040443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602492.040801:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821149696 00000100:00100000:2.0:1787602492.040810:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821149696 00010000:00010000:2.0:1787602492.040843:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed0 expref: 23 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602492.040883:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 61 00000100:00100000:2.0:1787602492.040891:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:2361:x1874436821149696:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602492.040904:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602492.040910:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed0 expref: 23 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602492.040922:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed0 expref: 23 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602492.040943:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af4706d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed0 expref: 23 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602492.040958:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602492.040963:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602492.040985:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602492.040992:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602492.041020:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602492.041106:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:2361:x1874436821149696:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 215us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602492.041114:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 61 00010000:00010000:1.0:1787602492.041210:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041219:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602492.041257:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787602492.041260:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602492.041276:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041287:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041297:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47154 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041303:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47154 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041320:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47154 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041327:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602492.041331:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47154 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041338:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47154 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041347:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:1.0:1787602492.041359:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602492.041363:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47154 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041369:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47154 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041386:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4715b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041393:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4715b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041399:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4715b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041403:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602492.041406:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4715b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041420:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4715b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041428:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff944a43b20c00) 00010000:00010000:1.0:1787602492.041430:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602492.041432:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4715b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041438:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4715b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041467:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af4714d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff0f expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041480:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff0f expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.041488:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:1.0:1787602492.041490:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602492.041492:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d000, rc 0) 00000100:00100000:1.0:1787602492.041513:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:10543:x1874436821149312:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 9246us (9475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602492.041530:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 129 00000001:00080000:0.0:1787602492.514085:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1787602492.514109:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:1.0:1787602492.776739:0:12061:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602492.776748:0:12061:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602492.776786:0:12061:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787602492.776792:0:12061:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787602492.899831:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787602493.021248:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602493.021265:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602493.021314:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787602493.021321:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787602493.021440:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c655880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838982144:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787602493.021566:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46907480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602493.025338:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c655880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838982144:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787602493.026738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602493.027086:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821149824 00000100:00100000:2.0:1787602493.027095:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821149824 00000100:00100000:2.0:1787602493.027154:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 130 00000100:00100000:2.0:1787602493.027164:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:10555:x1874436821149824:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787602493.027265:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787602493.027364:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:10555:x1874436821149824:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 201us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602493.027381:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 130 00000100:00100000:3.0:1787602493.032590:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602493.032746:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821150080 00000100:00100000:2.0:1787602493.032755:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821150080 00000100:00100000:2.0:1787602493.032814:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 131 00000100:00100000:2.0:1787602493.032834:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:10555:x1874436821150080:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602493.032855:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602493.032872:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af47169 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff16 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.032981:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47170 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.032994:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.033004:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602493.033014:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787602493.033175:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af47169 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff16 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.033203:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff16 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.033211:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602493.033214:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602493.033218:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477800, rc 0) 00000100:00100000:2.0:1787602493.033270:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:10555:x1874436821150080:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 447us (688us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787602493.033277:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 131 00000100:00100000:0.0:1787602493.038624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602493.038808:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821150464 00000100:00100000:2.0:1787602493.038818:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821150464 00000100:00100000:2.0:1787602493.038927:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 132 00000100:00100000:2.0:1787602493.038938:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:10555:x1874436821150464:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787602493.039013:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4717e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.039396:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4717e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.039410:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4717e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.039604:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4717e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.039611:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4717e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.039618:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4717e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.039624:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602493.039629:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4717e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.039637:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4717e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.039649:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602493.039652:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787602493.039657:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4717e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602493.039662:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4717e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602493.039835:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:10555:x1874436821150464:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 897us (1217us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787602493.039861:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 132 00000040:00080000:3.0:1787602493.040028:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602493.040033:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787602493.040538:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787602493.040548:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787602493.042788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602493.043165:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821150720 00000100:00100000:3.0:1787602493.043175:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821150720 00000100:00100000:3.0:1787602493.043234:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 34 00000100:00100000:3.0:1787602493.043244:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:10555:x1874436821150720:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787602493.043465:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+25:10555:x1874436821150720:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 221us (683us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787602493.043473:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 34 00000100:00100000:0.0:1787602493.044422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602493.044540:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821150208 00000100:00100000:3.0:1787602493.044547:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821150208 00000100:00100000:3.0:1787602493.044596:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:3.0:1787602493.044604:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+25:2362:x1874436821150208:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602493.044616:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602493.044640:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47170 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff16 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602493.044676:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:3.0:1787602493.044681:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602493.044731:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:2362:x1874436821150208:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 127us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602493.044737:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 8 00010000:00010000:2.0:1787602493.918056:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787602494.665426:0:12112:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787602494.665435:0:12112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602494.665475:0:12112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787602494.665480:0:12112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787602494.843665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602494.843739:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821150976 00000100:00100000:2.0:1787602494.843748:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821150976 00000100:00100000:2.0:1787602494.843820:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 133 00000100:00100000:2.0:1787602494.843830:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:10576:x1874436821150976:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:2.0:1787602494.843852:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602494.843870:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47185 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff1d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602494.843958:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af4718c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602494.843972:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af4718c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602494.843984:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af4718c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602494.843995:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787602494.844150:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47185 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff1d expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602494.844165:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af4718c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff1d expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602494.844189:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602494.844193:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787602494.844196:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476000, rc 0) 00000100:00100000:2.0:1787602494.844253:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+26:10576:x1874436821150976:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 424us (597us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787602494.844261:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 133 00000100:00080000:3.0:1787602494.845781:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602494.849249:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602494.849535:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821151104 00000100:00100000:1.0:1787602494.849545:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821151104 00000100:00100000:1.0:1787602494.849603:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 134 00000100:00100000:1.0:1787602494.849613:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+26:10576:x1874436821151104:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:1.0:1787602494.849676:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4719a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602494.849692:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4719a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602494.849703:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4719a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602494.849729:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4719a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602494.849735:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4719a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602494.849743:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4719a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602494.849749:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602494.849753:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4719a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602494.849768:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4719a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602494.849781:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:1.0:1787602494.849784:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602494.849788:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4719a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602494.849793:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4719a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602494.849867:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+26:10576:x1874436821151104:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 255us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602494.849876:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 134 00010000:00010000:1.0:1787602494.941199:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602494.945288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602494.945376:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821151232 00000100:00100000:3.0:1787602494.945385:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821151232 00000100:00100000:3.0:1787602494.945467:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 46 00000100:00100000:3.0:1787602494.945479:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821151232:12345-192.168.206.25@tcp:101:cat.0 00010000:00010000:3.0:1787602494.945496:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602494.945523:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054e28202/0x576b7af90af471a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff24 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602494.945550:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8ca639, atime: 0x6a8ca639, ctime: 0x6a8ca639, blocks: 0xb 00010000:00010000:3.0:1787602494.945567:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1787602494.945572:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602494.945581:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054e28202/0x576b7af90af471a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff24 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602494.945598:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054e28202/0x576b7af90af471a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff24 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602494.945628:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71a00, rc 0) 00000100:00100000:3.0:1787602494.945694:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2364:x1874436821151232:12345-192.168.206.25@tcp:101:cat.0 Request processed in 219us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602494.945701:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 46 00000100:00080000:0.0:1787602494.945879:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602494.951300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602494.952305:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821151360 00000100:00100000:2.0:1787602494.952317:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821151360 00002000:00100000:2.0:1787602494.952388:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff944947b71c00 x1874436821151360/t0(0) o3->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:330/0 lens 488/0 e 0 to 0 dl 1787602505 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787602494.952399:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944947b71c00 with x1874436821151360 ext(0->4095) 00002000:00010000:2.0:1787602494.952404:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944947b71c00 00000100:00100000:2.0:1787602494.952439:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:2.0:1787602494.952450:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821151360:12345-192.168.206.25@tcp:3:cat.0 00000100:00100000:2.0:1787602494.952670:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821151360:12345-192.168.206.25@tcp:3:cat.0 Request processed in 221us (1377us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787602494.952678:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 3 00002000:00100000:2.0:1787602494.952684:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff944947b71c00 x1874436821151360/t0(0) o3->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:330/0 lens 488/4536 e 0 to 0 dl 1787602505 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787602494.952691:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944947b71c00 with x1874436821151360 ext(0->4095) 00002000:00010000:2.0:1787602494.952694:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944947b71c00 00000100:00100000:1.0:1787602495.005368:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602495.005391:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838982272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602495.005491:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602495.005725:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838982272 00000100:00100000:2.0:1787602495.005732:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838982272 00000100:00100000:2.0:1787602495.005804:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787602495.005826:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874436838982272:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787602495.005851:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787602495.005862:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602495.005919:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874436838982272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602495.005927:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787602495.006003:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838982272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602495.009594:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838982400:0@lo:400:kworker.0 00000100:00100000:3.0:1787602495.009666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602495.009834:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838982400 00000100:00100000:2.0:1787602495.009842:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838982400 00000100:00100000:2.0:1787602495.009888:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787602495.009897:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838982400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602495.009982:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838982784:0@lo:400:kworker.0 00000100:00100000:0.0:1787602495.010012:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602495.010076:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838982784 00000100:00100000:0.0:1787602495.010080:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838982784 00000100:00100000:0.0:1787602495.010114:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787602495.010120:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838982784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602495.010154:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838982784:12345-0@lo:400:kworker.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602495.010160:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787602495.010191:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787602495.010196:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1787602495.010215:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944a7c484e00, transno 4294967301 00000004:00080000:0.0:1787602495.010224:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787602495.010233:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944a7509f480, transno 4294967304 00000100:00100000:0.0:1787602495.010239:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838982784:0@lo:400:kworker.0 00000100:00100000:0.0:1787602495.010539:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838982528:0@lo:400:kworker.0 00000100:00100000:0.0:1787602495.010570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602495.010592:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787602495.010611:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838982656:0@lo:400:kworker.0 00000100:00100000:0.0:1787602495.010637:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602495.010675:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838982528 00000100:00100000:0.0:1787602495.010679:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838982528 00000100:00100000:0.0:1787602495.010703:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838982656 00000100:00100000:0.0:1787602495.010705:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838982656 00000100:00100000:0.0:1787602495.010725:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787602495.010731:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838982528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602495.010768:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436838982528:12345-0@lo:400:kworker.0 Request processed in 37us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602495.010774:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787602495.010786:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787602495.010792:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838982656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602495.010820:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838982656:12345-0@lo:400:kworker.0 Request processed in 28us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602495.010826:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787602495.010871:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838982656:0@lo:400:kworker.0 00000100:00100000:0.0:1787602495.010880:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436838982528:0@lo:400:kworker.0 00000100:00080000:0.0:1787602495.010931:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787602495.010935:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602495.012732:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838982400:12345-0@lo:400:kworker.0 Request processed in 2830us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602495.012746:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787602495.013375:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602495.013392:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838982912:0@lo:400:kworker.0 00000100:00100000:0.0:1787602495.013446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602495.013625:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838982912 00000100:00100000:1.0:1787602495.013634:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838982912 00000100:00100000:1.0:1787602495.013703:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787602495.013712:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838982912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602495.013760:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838982912:12345-0@lo:400:kworker.0 Request processed in 49us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602495.013766:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1787602495.013938:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602495.013981:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838982912:0@lo:400:kworker.0 00000100:00100000:3.0:1787602495.015890:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838982400:0@lo:400:kworker.0 00000100:00100000:2.0:1787602495.236798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602495.236840:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602495.236862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602495.236890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602495.236912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602495.236943:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821151744 00000100:00100000:2.0:1787602495.236951:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821151744 00000100:00100000:2.0:1787602495.237001:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821151872 00000100:00100000:2.0:1787602495.237004:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821151872 00000100:00100000:2.0:1787602495.237023:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 61 00000100:00100000:2.0:1787602495.237032:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821151744:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602495.237133:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821151744:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602495.237141:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 61 00000100:00100000:2.0:1787602495.237157:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 62 00000100:00100000:2.0:1787602495.237177:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2364:x1874436821151872:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602495.237203:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2364:x1874436821151872:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602495.237209:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 62 00000100:00100000:1.0:1787602495.237382:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821151488 00000100:00100000:1.0:1787602495.237387:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821151488 00000100:00100000:1.0:1787602495.237427:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 284 00000100:00100000:1.0:1787602495.237441:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2364:x1874436821151488:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602495.237472:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2364:x1874436821151488:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 33us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602495.237479:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 284 00000100:00080000:0.0:1787602495.237885:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602495.237907:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821152000 00000100:00100000:0.0:1787602495.237912:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821152000 00000100:00100000:0.0:1787602495.237961:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821151616 00000100:00100000:0.0:1787602495.237964:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821151616 00000100:00100000:0.0:1787602495.237985:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 122 00000100:00100000:0.0:1787602495.237992:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821152000:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602495.238026:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821152000:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 35us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602495.238032:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 122 00000100:00100000:0.0:1787602495.238069:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 123 00000100:00100000:0.0:1787602495.238075:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+26:2364:x1874436821151616:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602495.238101:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+26:2364:x1874436821151616:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 26us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602495.238107:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 123 00000100:00080000:1.0:1787602495.238537:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602495.968146:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602496.545472:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7509c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838983040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602496.545584:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602496.545703:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838983040 00000100:00100000:3.0:1787602496.545722:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838983040 00000100:00100000:3.0:1787602496.545798:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787602496.545811:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838983040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602496.545864:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602496.552852:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838983040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7027us (7251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602496.552939:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787602496.553790:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7509c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838983040:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602496.996188:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787602497.141009:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000020:00080000:0.0:1787602497.141071:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff944a468d6c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787602497.141078:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6bf83f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff944a468d6480 00000020:00080000:0.0:1787602497.141082:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6bf83c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff944a7c63e000 00000020:00080000:0.0:1787602497.141099:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1787602497.141110:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787602497.141146:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787602497.141407:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1787602497.145650:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787602497.145674:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:2.0:1787602498.017564:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602499.037294:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602500.062325:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602500.126392:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602500.126427:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838983168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602500.126549:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602500.126636:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838983168 00000100:00100000:2.0:1787602500.126644:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838983168 00000100:00100000:2.0:1787602500.126711:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787602500.126721:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c5c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838983168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602500.126765:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602500.126818:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c5c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838983168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602500.126825:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787602500.126849:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602500.126883:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787602500.126889:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787602500.126921:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838983168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602500.129434:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602500.129592:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602500.129616:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7509d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838983424:0@lo:400:kworker.0 00000100:00100000:1.0:1787602500.129696:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602500.129754:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838983424 00000100:00100000:1.0:1787602500.129762:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838983424 00000100:00100000:1.0:1787602500.129817:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787602500.129828:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838983424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602500.129886:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436838983424:12345-0@lo:400:kworker.0 Request processed in 60us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602500.129895:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787602500.129943:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7509d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436838983424:0@lo:400:kworker.0 00000100:00100000:3.0:1787602500.129997:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7509dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838983296:0@lo:400:kworker.0 00000100:00100000:3.0:1787602500.130070:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602500.130212:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838983296 00000100:00100000:1.0:1787602500.130217:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838983296 00000100:00100000:1.0:1787602500.130251:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787602500.130259:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838983296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602500.130297:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3312:x1874436838983296:12345-0@lo:400:kworker.0 Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602500.130319:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787602500.130369:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7509dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838983296:0@lo:400:kworker.0 00000100:00100000:2.0:1787602500.130885:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7509c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838983552:0@lo:400:kworker.0 00000100:00100000:2.0:1787602500.130926:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602500.131003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838983552 00000100:00100000:3.0:1787602500.131009:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838983552 00000100:00100000:3.0:1787602500.131082:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787602500.131099:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838983552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602500.137854:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838983552:12345-0@lo:400:kworker.0 Request processed in 6747us (6915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602500.137872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1787602500.138026:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602500.138225:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7509c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838983552:0@lo:400:kworker.0 00000100:00100000:2.0:1787602500.138260:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602500.138273:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7509dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838983680:0@lo:400:kworker.0 00000100:00100000:2.0:1787602500.138407:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602500.138449:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838983680 00000100:00100000:2.0:1787602500.138456:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838983680 00000100:00100000:2.0:1787602500.138565:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787602500.138575:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838983680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602500.138628:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838983680:12345-0@lo:400:kworker.0 Request processed in 54us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602500.138635:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787602500.138673:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602500.138694:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7509dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838983680:0@lo:400:kworker.0 00000100:00100000:0.0:1787602500.138886:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602500.138897:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7509d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838983808:0@lo:400:kworker.0 00000100:00100000:0.0:1787602500.138947:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602500.138978:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838983808 00000100:00100000:0.0:1787602500.138982:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838983808 00000100:00100000:0.0:1787602500.139017:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787602500.139025:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838983808:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787602500.139233:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602500.139303:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436838983808:12345-0@lo:400:kworker.0 Request processed in 278us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602500.139310:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787602500.139455:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7509d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436838983808:0@lo:400:kworker.0 00000100:00100000:2.0:1787602500.333819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602500.333900:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821152128 00000100:00100000:3.0:1787602500.333913:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821152128 00000100:00100000:3.0:1787602500.334023:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 135 00000100:00100000:3.0:1787602500.334090:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:10229:x1874436821152128:12345-192.168.206.25@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787602500.334238:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:10229:x1874436821152128:12345-192.168.206.25@tcp:60:lhsmtool_posix.0 Request processed in 204us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602500.334250:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 135 00000100:00080000:2.0:1787602500.334389:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602500.337137:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602500.337364:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821152384 00000100:00100000:1.0:1787602500.337376:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821152384 00000100:00100000:1.0:1787602500.337444:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:1.0:1787602500.337456:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:10229:x1874436821152384:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787602500.338872:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:10229:x1874436821152384:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 1398us (1732us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787602500.338887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:1.0:1787602500.360932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602500.360982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602500.361015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602500.361100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602500.361316:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821152512 00000100:00100000:2.0:1787602500.361339:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821152512 00000100:00100000:2.0:1787602500.361401:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 286 00000100:00100000:2.0:1787602500.361413:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821152512:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602500.361510:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821152512:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 98us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602500.361541:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 286 00000100:00100000:0.0:1787602500.361869:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821152768 00000100:00100000:0.0:1787602500.361875:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821152768 00000100:00100000:0.0:1787602500.361930:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821152640 00000100:00100000:0.0:1787602500.361934:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821152640 00000100:00100000:0.0:1787602500.361960:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 64 00000100:00100000:0.0:1787602500.361967:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821152768:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602500.362018:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821152768:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 51us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602500.362026:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 64 00000100:00100000:0.0:1787602500.362075:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 65 00000100:00100000:0.0:1787602500.362082:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821152640:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602500.362109:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821152640:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 28us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602500.362116:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 65 00000100:00100000:0.0:1787602500.362135:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821152896 00000100:00100000:0.0:1787602500.362139:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821152896 00000100:00100000:0.0:1787602500.362170:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 127 00000100:00100000:0.0:1787602500.362186:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821152896:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602500.362217:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2364:x1874436821152896:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 32us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602500.362224:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 127 00000100:00080000:2.0:1787602500.362645:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787602500.362651:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602500.362653:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602500.584286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602500.584606:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821153024 00000100:00100000:3.0:1787602500.584620:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821153024 00000100:00100000:3.0:1787602500.584697:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 136 00000100:00100000:3.0:1787602500.584711:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:11028:x1874436821153024:12345-192.168.206.25@tcp:101:lsof.0 00010000:00010000:3.0:1787602500.584740:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602500.584769:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff2b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602500.584924:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602500.584941:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602500.584953:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602500.585308:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787602500.585313:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602500.585590:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602500.585624:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff2b expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602500.585645:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff2b expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602500.585656:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:3.0:1787602500.585659:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602500.585664:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70400, rc 0) 00000100:00100000:3.0:1787602500.585743:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:11028:x1874436821153024:12345-192.168.206.25@tcp:101:lsof.0 Request processed in 1035us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602500.585751:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 136 00010000:00010000:2.0:1787602501.085312:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602501.663865:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838983936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602501.663961:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602501.664463:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838983936 00000100:00100000:3.0:1787602501.664487:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838983936 00000100:00100000:3.0:1787602501.664562:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787602501.664575:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838983936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602501.664623:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602501.664696:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838983936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602501.664704:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787602501.664885:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838983936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602502.109482:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787602502.246254:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1787602502.246290:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787602502.246499:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787602502.246513:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787602503.133311:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787602503.262125:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602503.262138:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787602503.262628:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:3.0:1787602503.262640:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:3.0:1787602504.145923:0:12314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:15:01 (1787602501) 00010000:00010000:2.0:1787602504.157309:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602505.186651:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602505.245352:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602505.245385:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838984064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602505.245488:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602505.246017:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838984448:0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246090:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602505.246115:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602505.246121:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838984320:0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602505.246182:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838984448 00000100:00100000:0.0:1787602505.246192:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838984448 00000100:00100000:0.0:1787602505.246254:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838984320 00000100:00100000:0.0:1787602505.246258:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838984320 00000100:00100000:0.0:1787602505.246284:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787602505.246294:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436838984448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246356:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436838984448:12345-0@lo:400:kworker.0 Request processed in 63us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602505.246363:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787602505.246389:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787602505.246396:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ef94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838984320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246458:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ef94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838984320:12345-0@lo:400:kworker.0 Request processed in 52us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602505.246465:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787602505.246514:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838984320:0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246527:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838984448:0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246555:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838984192:0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246588:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602505.246711:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ea5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838984704:0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246737:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602505.246757:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787602505.246763:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838984576:0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246790:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602505.246819:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838984192 00000100:00100000:0.0:1787602505.246823:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838984192 00000100:00100000:0.0:1787602505.246849:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787602505.246856:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838984192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246891:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838984192:12345-0@lo:400:kworker.0 Request processed in 36us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602505.246898:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787602505.246926:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838984576 00000100:00100000:0.0:1787602505.246930:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838984576 00000100:00100000:0.0:1787602505.246959:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787602505.246966:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838984576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.246998:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838984576:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602505.247014:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787602505.247062:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838984704 00000100:00100000:0.0:1787602505.247066:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838984704 00000100:00100000:0.0:1787602505.247089:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787602505.247096:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838984704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.247125:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838984704:12345-0@lo:400:kworker.0 Request processed in 30us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602505.247131:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787602505.247159:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838984576:0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.247168:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838984192:0@lo:400:kworker.0 00000100:00100000:0.0:1787602505.247176:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838984704:0@lo:400:kworker.0 00000100:00100000:2.0:1787602505.247375:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838984064 00000100:00100000:2.0:1787602505.247380:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838984064 00000100:00100000:2.0:1787602505.247420:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787602505.247429:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838984064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602505.247471:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602505.247526:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838984064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602505.247533:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787602505.247553:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787602505.247558:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602505.247561:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602505.247852:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ea4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838984064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602505.311415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602505.311609:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821153280 00000100:00100000:2.0:1787602505.311621:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821153280 00000100:00100000:2.0:1787602505.311715:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 137 00000100:00100000:2.0:1787602505.311729:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:11293:x1874436821153280:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602505.311766:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602505.311795:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af471b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff32 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.311924:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af471bd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.311941:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af471bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.311954:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af471bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.311972:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.311979:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.311986:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312536:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af471cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312547:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af471cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312554:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af471cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602505.312565:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787602505.312788:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af471bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312797:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af471bd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312810:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af471bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312817:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602505.312821:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af471bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312828:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af471bd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312843:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff944a4a576100) 00010000:00010000:2.0:1787602505.312846:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602505.312852:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af471bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312858:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af471bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312872:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312878:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471c4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312883:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312888:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602505.312891:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312905:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471c4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312913:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff944a48947900) 00010000:00010000:2.0:1787602505.312916:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602505.312918:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471c4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.312924:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471c4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.313485:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af471b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff32 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.313504:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af471cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff32 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602505.313512:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:2.0:1787602505.313514:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602505.313517:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476800, rc 0) 00000100:00100000:2.0:1787602505.313589:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:11293:x1874436821153280:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 1862us (2188us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787602505.313599:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 137 00000100:00080000:0.0:1787602505.314497:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602505.317700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602505.317823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602505.318534:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821153536 00000100:00100000:0.0:1787602505.318549:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821153536 00000100:00100000:0.0:1787602505.318648:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:0.0:1787602505.318661:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:2363:x1874436821153536:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602505.318681:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602505.318713:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af471cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff32 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602505.318739:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:0.0:1787602505.318745:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602505.318818:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:2363:x1874436821153536:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 160us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602505.318849:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:3.0:1787602505.325536:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821153408 00000100:00100000:3.0:1787602505.325559:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821153408 00000100:00100000:3.0:1787602505.325875:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 138 00000100:00100000:3.0:1787602505.325889:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:11293:x1874436821153408:12345-192.168.206.25@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787602505.326033:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:11293:x1874436821153408:12345-192.168.206.25@tcp:59:lhsmtool_posix.0 Request processed in 147us (8347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602505.326059:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 138 00000100:00100000:2.0:1787602505.478396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602505.478493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602505.478538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602505.478591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602505.478648:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821153664 00000100:00100000:1.0:1787602505.478661:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821153664 00000100:00100000:1.0:1787602505.478761:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 288 00000100:00100000:1.0:1787602505.478776:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821153664:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602505.478892:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821153664:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 120us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602505.478901:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 288 00000100:00100000:1.0:1787602505.479105:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821154048 00000100:00100000:1.0:1787602505.479110:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821154048 00000100:00100000:1.0:1787602505.479174:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 131 00000100:00100000:1.0:1787602505.479182:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2363:x1874436821154048:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602505.479230:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2363:x1874436821154048:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 49us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602505.479238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 131 00000100:00080000:1.0:1787602505.479256:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602505.484073:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821153792 00000100:00100000:2.0:1787602505.484077:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821153920 00000100:00100000:2.0:1787602505.484094:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821153920 00000100:00100000:0.0:1787602505.484094:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821153792 00000100:00080000:1.0:1787602505.484135:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602505.484195:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 67 00000100:00100000:2.0:1787602505.484209:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a751b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821153920:12345-192.168.206.25@tcp:400:kworker.0 00000100:00080000:1.0:1787602505.484267:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602505.484331:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 68 00000100:00100000:2.0:1787602505.484338:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a751b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2363:x1874436821153920:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 130us (5744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602505.484345:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2363:x1874436821153792:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602505.484358:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 67 00000100:00100000:1.0:1787602505.484382:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2363:x1874436821153792:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 42us (6002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602505.484390:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 68 00010000:00010000:2.0:1787602506.206866:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787602506.334679:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787602506.334688:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602506.334722:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 2 00000040:00080000:2.0:1787602506.334729:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787602506.781538:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602506.781568:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838984832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602506.782227:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602506.782292:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838984832 00000100:00100000:3.0:1787602506.782302:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838984832 00000100:00100000:3.0:1787602506.782515:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787602506.782955:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7512ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838984832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602506.783008:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602506.783119:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7512ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838984832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602506.783219:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e48d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838984832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602506.788833:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:3.0:1787602507.229206:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602507.336301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602507.336348:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821154176 00000100:00100000:3.0:1787602507.336371:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821154176 00000100:00100000:3.0:1787602507.336469:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 139 00000100:00100000:3.0:1787602507.336484:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:11335:x1874436821154176:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602507.336521:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602507.336548:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af471d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff39 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.336633:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af471e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.336650:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af471e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.336665:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af471e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.336684:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.336692:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.336698:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337015:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af471e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337023:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af471e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337029:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af471e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337064:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602507.337075:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af471e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337085:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af471e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337099:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:3.0:1787602507.337103:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602507.337108:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af471e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337115:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af471e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337129:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337135:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337142:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337147:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602507.337155:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337161:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337170:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff944a4a576a00) 00010000:00010000:3.0:1787602507.337172:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602507.337182:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337189:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af471e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337227:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af471d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff39 expref: 15 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337238:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:3.0:1787602507.337241:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602507.337245:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af471d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff39 expref: 15 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.337255:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70800, rc 0) 00000100:00100000:3.0:1787602507.337330:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:11335:x1874436821154176:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 850us (1043us total) trans 0 rc 301/301 00000100:00100000:3.0:1787602507.337339:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 139 00000100:00080000:0.0:1787602507.343105:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602507.359472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.360497:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821154432 00000100:00100000:0.0:1787602507.360513:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821154432 00000100:00100000:0.0:1787602507.360577:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 140 00000100:00100000:0.0:1787602507.360589:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:11335:x1874436821154432:12345-192.168.206.25@tcp:36:lfs.0 00010000:00010000:0.0:1787602507.360653:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602507.361832:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af46b57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd72 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.361859:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:0.0:1787602507.361865:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602507.362179:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.362198:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff2b expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.362208:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.362255:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff2b expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.362288:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff2b expref: 5 pid: 5835 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602507.362307:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838984960:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602507.362422:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b2dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602507.368163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.368499:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838984960:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602507.368534:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602507.372500:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821154560 00000100:00100000:2.0:1787602507.372520:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821154560 00010000:00010000:2.0:1787602507.372594:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff2b expref: 6 pid: 5835 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602507.372640:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 62 00000100:00100000:2.0:1787602507.372651:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2361:x1874436821154560:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602507.372669:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602507.372677:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff2b expref: 6 pid: 5835 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.372693:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff2b expref: 6 pid: 5835 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.372721:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af471af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff2b expref: 6 pid: 5835 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.372753:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:2.0:1787602507.372759:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.372769:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.372776:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.372806:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602507.372880:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821154560:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 230us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602507.372889:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 62 00010000:00010000:2.0:1787602507.372923:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.372932:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.372957:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.372967:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.372975:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787602507.373627:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787602507.374874:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787602507.374905:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.374918:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.374927:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.374933:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602507.374939:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.374948:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.374970:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48947c00) 00010000:00010000:2.0:1787602507.374974:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602507.374979:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.374986:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af471ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602507.375009:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002400fd0b reply state 00000000bca6cac8 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602507.375019:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602507.375159:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:11335:x1874436821154432:12345-192.168.206.25@tcp:36:lfs.0 Request processed in 14567us (15697us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787602507.375168:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 140 00010000:00010000:2.0:1787602507.381665:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.381694:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.381702:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.381709:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602507.381715:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.381724:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.381744:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff944a48947a00) 00010000:00010000:2.0:1787602507.381747:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602507.381752:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.381759:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af471f5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602507.384227:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1787602507.444614:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602507.444698:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821154688 00000100:00100000:3.0:1787602507.444712:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821154688 00000100:00100000:3.0:1787602507.444789:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 141 00000100:00100000:3.0:1787602507.444802:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:11343:x1874436821154688:12345-192.168.206.25@tcp:101:lctl.0 00010000:00010000:3.0:1787602507.444833:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602507.447123:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af471fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff40 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.447232:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af47203 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.447269:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af47203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.450728:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af47203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602507.450832:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787602507.450838:0:9459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602507.450877:0:9459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af47203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.450926:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af471fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff40 expref: 15 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.450951:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af47203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff40 expref: 14 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.450962:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88500) 00010000:00010000:3.0:1787602507.450965:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602507.450968:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71c00, rc 0) 00000100:00100000:3.0:1787602507.451080:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:11343:x1874436821154688:12345-192.168.206.25@tcp:101:lctl.0 Request processed in 6279us (6479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602507.451090:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 141 00000100:00100000:2.0:1787602507.495762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602507.496326:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821154816 00000100:00100000:1.0:1787602507.496341:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821154816 00000100:00100000:1.0:1787602507.496420:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 142 00000100:00100000:1.0:1787602507.496432:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:11349:x1874436821154816:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602507.496469:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602507.496498:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af4720a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff47 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496579:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af47211 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496597:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af47211 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496631:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af47211 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496649:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47218 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496656:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496662:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496801:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af4721f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496810:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af4721f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496816:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af4721f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602507.496855:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787602507.496860:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602507.496887:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af4721f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496900:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af47211 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496906:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af47211 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496925:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af47211 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496931:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602507.496937:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af47211 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496945:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af47211 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496959:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88500) 00010000:00010000:1.0:1787602507.496962:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602507.496967:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af47211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496973:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af47211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496989:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.496996:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47218 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.497002:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47218 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.497007:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602507.497010:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47218 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.497026:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47218 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.497082:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff944a43b20400) 00010000:00010000:1.0:1787602507.497085:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602507.497088:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47218 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.497094:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47218 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.497132:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af4720a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff47 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.497147:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af4721f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff47 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.497154:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:1.0:1787602507.497156:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787602507.497158:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d200, rc 0) 00000100:00100000:1.0:1787602507.497247:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:11349:x1874436821154816:12345-192.168.206.25@tcp:101:bash.0 Request processed in 817us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602507.497256:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 142 00000100:00100000:0.0:1787602507.499900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602507.500158:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821155072 00000100:00100000:1.0:1787602507.500171:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821155072 00000100:00100000:0.0:1787602507.500370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 143 00000100:00100000:0.0:1787602507.500382:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+15:11349:x1874436821155072:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:0.0:1787602507.500409:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602507.500445:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47226 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff4e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.500622:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4722d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.500639:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4722d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.500652:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4722d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.509321:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.509344:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.509357:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787602507.510356:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787602507.512716:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.515833:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.515854:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.516090:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4722d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.516099:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4722d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.516120:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4722d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.516126:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602507.516131:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4722d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.516138:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4722d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.516151:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:1.0:1787602507.516154:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602507.516158:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4722d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.516164:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af4722d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602507.516180:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bea4855 reply state 000000006ab98a5a transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602507.516189:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787602507.516236:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47226 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff4e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.516250:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff4e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.516258:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48aced00) 00010000:00010000:1.0:1787602507.516260:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602507.516268:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459c00, rc 0) 00000100:00100000:1.0:1787602507.516404:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+18:11349:x1874436821155072:12345-192.168.206.25@tcp:101:bash.0 Request processed in 16024us (16516us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787602507.516413:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 143 00010000:00010000:2.0:1787602507.524786:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.524810:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.524820:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.524855:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602507.524862:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.524870:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.524892:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48ace100) 00010000:00010000:2.0:1787602507.524896:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602507.524902:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.524909:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47234 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602507.527194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602507.527341:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821155200 00000100:00100000:2.0:1787602507.527362:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821155200 00000100:00100000:2.0:1787602507.527472:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00100000:2.0:1787602507.527488:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2362:x1874436821155200:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:2.0:1787602507.527511:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602507.527541:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47249 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff55 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602507.527576:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602507.527599:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1787602507.527605:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602507.527616:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47249 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff55 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.527666:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47249 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff55 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.527684:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476400, rc 0) 00000100:00100000:2.0:1787602507.527768:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821155200:12345-192.168.206.25@tcp:101:bash.0 Request processed in 285us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602507.527776:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00080000:0.0:1787602507.528000:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602507.535023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602507.535739:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821155328 00000100:00100000:1.0:1787602507.535756:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821155328 00000100:00100000:1.0:1787602507.535825:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 48 00000100:00100000:1.0:1787602507.535840:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:11349:x1874436821155328:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602507.535860:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602507.535879:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff5c expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.535912:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47249 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff55 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.535921:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602507.535925:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602507.535931:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.535969:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47249 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff55 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602507.535983:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47249 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff55 expref: 7 pid: 6692 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602507.536011:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e6b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8475:1874436838985088:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602507.536154:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a41254c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602507.539100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602507.539194:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821155456 00000100:00100000:2.0:1787602507.539207:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821155456 00010000:00010000:2.0:1787602507.539262:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47249 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff55 expref: 8 pid: 6692 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602507.539312:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 63 00000100:00100000:2.0:1787602507.539324:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2362:x1874436821155456:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602507.539343:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602507.539373:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47249 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff55 expref: 8 pid: 6692 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.539390:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47249 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff55 expref: 8 pid: 6692 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.539420:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602507.539425:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602507.539444:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 8 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.539475:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 8 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.539525:0:8454:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 8 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602507.539541:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8454:1874436838985216:192.168.206.25@tcp:105: 00000100:00100000:2.0:1787602507.539743:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46b92540 going to sleep for 11 seconds 00010000:00010000:0.0:1787602507.540480:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47249 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff55 expref: 8 pid: 6692 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602507.540503:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e6b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8475:1874436838985088:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602507.540536:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.540549:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c400, rc 0) 00000100:00100000:0.0:1787602507.540608:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:11349:x1874436821155328:12345-192.168.206.25@tcp:101:bash.0 Request processed in 4773us (5600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602507.540618:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 48 00000100:00100000:2.0:1787602507.544678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.544982:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8454:1874436838985216:192.168.206.25@tcp:105: 00010000:00010000:0.0:1787602507.545155:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602507.545220:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821155456:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 5897us (6188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602507.545234:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 63 00000100:00100000:3.0:1787602507.545509:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821155712 00000100:00100000:3.0:1787602507.545519:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821155712 00000100:00100000:3.0:1787602507.545579:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00100000:3.0:1787602507.545590:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+17:11349:x1874436821155712:12345-192.168.206.25@tcp:35:bash.0 00000100:00100000:3.0:1787602507.546017:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+18:11349:x1874436821155712:12345-192.168.206.25@tcp:35:bash.0 Request processed in 428us (1353us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787602507.546025:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00100000:1.0:1787602507.614651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602507.614799:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821155968 00000100:00100000:2.0:1787602507.614813:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821155968 00000100:00100000:2.0:1787602507.614934:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 144 00000100:00100000:2.0:1787602507.614950:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+18:11359:x1874436821155968:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:2.0:1787602507.614982:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602507.615010:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff63 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602507.615225:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787602507.615407:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47257 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff63 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.615426:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88500) 00010000:00010000:2.0:1787602507.615429:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602507.615443:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af47257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff63 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.615485:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476400, rc 0) 00000100:00100000:2.0:1787602507.615568:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:11359:x1874436821155968:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 622us (932us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787602507.615577:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 144 00000100:00100000:1.0:1787602507.618642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602507.618712:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821156224 00000100:00100000:3.0:1787602507.618724:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821156224 00000100:00100000:3.0:1787602507.618799:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 37 00000100:00100000:3.0:1787602507.618811:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:11359:x1874436821156224:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:3.0:1787602507.620262:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:11359:x1874436821156224:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 756us (937us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787602507.620281:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 37 00000100:00100000:3.0:1787602507.705778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.707623:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821156352 00000100:00100000:0.0:1787602507.707643:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821156352 00000100:00100000:0.0:1787602507.707743:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 145 00000100:00100000:0.0:1787602507.707755:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:11365:x1874436821156352:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602507.707790:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602507.707817:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff6a expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.707903:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af4726c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.707920:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af4726c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.707940:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af4726c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602507.708013:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787602507.708018:0:9459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602507.708097:0:9459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af4726c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.708150:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff6a expref: 22 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.708170:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af4726c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff6a expref: 21 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.708180:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602507.708183:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602507.708186:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459400, rc 0) 00000100:00100000:0.0:1787602507.708261:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:11365:x1874436821156352:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 508us (2498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602507.708268:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 145 00000100:00100000:1.0:1787602507.712948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.714193:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821156608 00000100:00100000:0.0:1787602507.714211:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821156608 00000100:00100000:0.0:1787602507.714303:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 146 00000100:00100000:0.0:1787602507.714317:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:11365:x1874436821156608:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602507.714346:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602507.714373:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47273 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff71 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.714511:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4727a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.714527:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4727a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.714539:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4727a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602507.714570:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787602507.714733:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47273 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff71 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.714755:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4727a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff71 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.714764:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48aced00) 00010000:00010000:0.0:1787602507.714767:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602507.714772:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459a00, rc 0) 00000100:00100000:0.0:1787602507.714857:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:11365:x1874436821156608:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 543us (1923us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787602507.714865:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 146 00000100:00100000:1.0:1787602507.720673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602507.720797:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821156864 00000100:00100000:3.0:1787602507.720811:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821156864 00000100:00100000:3.0:1787602507.720900:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 147 00000100:00100000:3.0:1787602507.720920:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:11365:x1874436821156864:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602507.720961:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602507.721006:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47288 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff78 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.721179:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4728f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.721196:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4728f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.723465:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4728f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602507.723538:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787602507.723751:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47288 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff78 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.723778:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4728f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff78 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602507.723789:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48aced00) 00010000:00010000:3.0:1787602507.723792:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787602507.723796:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70200, rc 0) 00000100:00100000:3.0:1787602507.723883:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+25:11365:x1874436821156864:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 2971us (3222us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787602507.723893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 147 00000100:00100000:3.0:1787602507.725503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.727567:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821156992 00000100:00100000:0.0:1787602507.727594:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821156992 00000100:00100000:0.0:1787602507.727698:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:0.0:1787602507.727710:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+25:2361:x1874436821156992:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602507.727729:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602507.727762:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4727a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff71 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.727786:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48aced00) 00010000:00010000:0.0:1787602507.727791:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602507.727861:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:2361:x1874436821156992:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 154us (2371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602507.727868:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:1.0:1787602507.736518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602507.736627:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821157120 00000100:00100000:2.0:1787602507.736641:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821157120 00000100:00100000:2.0:1787602507.736716:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:2.0:1787602507.736730:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2364:x1874436821157120:12345-192.168.206.25@tcp:1:lfs.0 00010000:00010000:2.0:1787602507.736789:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.736817:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 6 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.736841:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602507.736847:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602507.736852:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.738475:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 6 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.738505:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 6 pid: 8475 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602507.738551:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1874436838985344:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602507.738683:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46b92b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602507.740856:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1874436838985344:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602507.740904:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602507.741448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602507.742145:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821157248 00000100:00100000:2.0:1787602507.742157:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821157248 00002000:00100000:2.0:1787602507.742224:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff944a6ea7ea00 x1874436821157248/t0(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:343/0 lens 504/0 e 0 to 0 dl 1787602518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787602507.742235:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a6ea7ea00 with x1874436821157248 ext(0->12) 00010000:00010000:2.0:1787602507.742247:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 7 pid: 8475 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.742264:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 7 pid: 8475 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602507.742272:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff944a6ea7ea00 00000100:00100000:2.0:1787602507.742311:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:2.0:1787602507.742323:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821157248:12345-192.168.206.25@tcp:4:lfs.0 00000100:00100000:2.0:1787602507.743308:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2361:x1874436821157248:12345-192.168.206.25@tcp:4:lfs.0 Request processed in 980us (1856us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787602507.743321:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 2 00002000:00100000:2.0:1787602507.743343:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff944a6ea7ea00 x1874436821157248/t4294967305(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:343/0 lens 504/448 e 0 to 0 dl 1787602518 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787602507.743353:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a6ea7ea00 with x1874436821157248 ext(0->12) 00010000:00010000:2.0:1787602507.743363:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 9 pid: 8475 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.743377:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 9 pid: 8475 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602507.743385:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff944a6ea7ea00 00000100:00100000:1.0:1787602507.751637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602507.751760:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821157376 00000100:00100000:2.0:1787602507.751772:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821157376 00010000:00010000:2.0:1787602507.751820:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 9 pid: 8475 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602507.751869:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 64 00000100:00100000:2.0:1787602507.751882:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2364:x1874436821157376:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602507.751974:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787602507.752000:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787602507.752004:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787602506 00002000:00010000:2.0:1787602507.752007:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787602506 00002000:00010000:2.0:1787602507.752009:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787602506 00010000:00010000:2.0:1787602507.752017:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 9 pid: 8475 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.752242:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 9 pid: 8475 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.752296:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af47250 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff5c expref: 9 pid: 8475 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.752316:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602507.752321:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602507.752328:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.752339:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.752441:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602507.752512:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2364:x1874436821157376:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 631us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602507.752521:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 64 00010000:00010000:0.0:1787602507.759192:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.759220:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.759267:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.759277:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.759288:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.761159:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602507.761168:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.761181:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.761220:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.761230:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af4729d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602507.761953:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2364:x1874436821157120:12345-192.168.206.25@tcp:1:lfs.0 Request processed in 25219us (25441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602507.761966:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:1.0:1787602507.776648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602507.777100:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821157632 00000100:00100000:2.0:1787602507.777113:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821157632 00000100:00100000:2.0:1787602507.777189:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 38 00000100:00100000:2.0:1787602507.777221:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a5058b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:11365:x1874436821157632:12345-192.168.206.25@tcp:35:lfs.0 00000004:00010000:2.0:1787602507.777540:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4728f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff78 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602507.778579:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787602507.778662:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787602507.780184:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787602507.780539:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.780578:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff4e expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.780589:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.780642:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff4e expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.780664:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff4e expref: 28 pid: 5835 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602507.780682:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1874436838985472:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602507.780812:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46b92b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602507.786692:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1874436838985472:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602507.786731:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602507.787397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.788374:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821157760 00000100:00100000:0.0:1787602507.788388:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821157760 00010000:00010000:0.0:1787602507.788453:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff4e expref: 29 pid: 5835 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602507.788509:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 65 00000100:00100000:0.0:1787602507.788521:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:2362:x1874436821157760:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602507.788540:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602507.788549:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff4e expref: 29 pid: 5835 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.788571:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff4e expref: 29 pid: 5835 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.788598:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af4723b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff4e expref: 29 pid: 5835 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.788619:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48aced00) 00010000:00010000:0.0:1787602507.788624:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.788634:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.788663:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.788697:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602507.788766:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+28:2362:x1874436821157760:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 247us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602507.788773:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 65 00010000:00010000:2.0:1787602507.788979:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.788997:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602507.789226:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787602507.792710:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787602507.793848:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874436838985600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787602507.794091:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602507.794230:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a43851840 going to sleep for 11 seconds 00000100:00100000:2.0:1787602507.794559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838985600 00000100:00100000:2.0:1787602507.794570:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838985600 00000100:00080000:0.0:1787602507.794694:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602507.794810:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602507.794823:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1874436838985600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787602507.794954:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1874436838985600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 132us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602507.794962:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787602507.795071:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874436838985600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787602507.795712:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787602507.795805:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874436838985728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787602507.795864:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602507.796799:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46b92b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602507.797120:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838985728 00000100:00100000:1.0:1787602507.797130:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838985728 00000100:00100000:1.0:1787602507.797187:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602507.797197:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1874436838985728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787602507.797733:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1874436838985728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 533us (1866us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787602507.797743:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787602507.798261:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874436838985728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787602507.798532:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787602507.798593:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.798605:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.798614:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.798621:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602507.798626:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.798634:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.798653:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48aced00) 00010000:00010000:2.0:1787602507.798656:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787602507.798662:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.798669:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af472a4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787602507.799172:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787602507.799613:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787602507.799628:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338905590563ns, next at 339905587241ns, rc = 0 00000001:00080000:2.0:1787602507.799638:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787602507.799687:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48aced00) 00010000:00010000:2.0:1787602507.799692:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787602507.799701:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4728f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff78 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602507.799965:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a5058b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+31:11365:x1874436821157632:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 22745us (23330us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787602507.799976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 38 00000020:00080000:2.0:1787602507.799982:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787602507.802692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602507.802780:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821157888 00000100:00100000:2.0:1787602507.802793:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821157888 00000100:00100000:2.0:1787602507.802869:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 148 00000100:00100000:2.0:1787602507.802893:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+31:11365:x1874436821157888:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:2.0:1787602507.802925:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602507.802956:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af472ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff7f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.803070:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af472ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff7f expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.803089:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af472ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff7f expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.803114:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602507.803118:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602507.803138:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477600, rc 0) 00000100:00100000:2.0:1787602507.803197:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:11365:x1874436821157888:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 317us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602507.803205:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 148 00000100:00100000:3.0:1787602507.805536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.807711:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821158144 00000100:00100000:0.0:1787602507.807726:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821158144 00000100:00100000:0.0:1787602507.807830:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:0.0:1787602507.807841:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:11365:x1874436821158144:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602507.808126:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+33:11365:x1874436821158144:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 285us (2601us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787602507.808134:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 39 00000001:00080000:0.0:1787602507.915371:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1787602507.915397:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1787602507.916922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.917065:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821158400 00000100:00100000:0.0:1787602507.917078:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821158400 00000100:00100000:0.0:1787602507.917158:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 149 00000100:00100000:0.0:1787602507.917171:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+33:11375:x1874436821158400:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602507.917212:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602507.917237:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff86 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602507.917396:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787602507.917570:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff86 expref: 35 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.917600:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88500) 00010000:00010000:0.0:1787602507.917604:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602507.917610:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff86 expref: 35 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.917625:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459a00, rc 0) 00000100:00100000:0.0:1787602507.917702:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:11375:x1874436821158400:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 533us (792us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787602507.917710:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 149 00000100:00100000:2.0:1787602507.924921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.928826:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821158528 00000100:00100000:0.0:1787602507.928849:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821158528 00000100:00100000:0.0:1787602507.928942:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 150 00000100:00100000:0.0:1787602507.928955:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:11375:x1874436821158528:12345-192.168.206.25@tcp:34:lfs.0 00010000:00010000:0.0:1787602507.929097:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.929120:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.929137:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.929155:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.929162:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.929189:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.929330:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.929340:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.929347:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602507.930256:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930272:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930279:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930348:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930356:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602507.930361:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930369:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930384:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602507.930401:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602507.930407:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930414:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930440:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930448:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930454:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930460:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602507.930463:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930470:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930478:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48ace300) 00010000:00010000:0.0:1787602507.930481:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602507.930484:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930489:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930508:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930523:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930528:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930534:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602507.930537:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930542:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930549:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602507.930551:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602507.930554:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.930559:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602507.931192:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:11375:x1874436821158528:12345-192.168.206.25@tcp:34:lfs.0 Request processed in 2233us (6280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602507.931205:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 150 00000100:00100000:2.0:1787602507.933726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.933809:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821158784 00000100:00100000:0.0:1787602507.933822:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821158784 00000100:00100000:0.0:1787602507.933895:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 40 00000100:00100000:0.0:1787602507.933907:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:11375:x1874436821158784:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602507.934272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+35:11375:x1874436821158784:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 366us (557us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787602507.934308:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 40 00000100:00100000:3.0:1787602507.980637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.980815:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821159040 00000100:00100000:0.0:1787602507.980828:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821159040 00000100:00100000:0.0:1787602507.980904:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 151 00000100:00100000:0.0:1787602507.980916:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+35:11378:x1874436821159040:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602507.980948:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602507.980972:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff8d expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981106:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981123:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981136:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981152:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981158:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981164:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981325:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981357:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981364:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602507.981376:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787602507.981504:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981512:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981519:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981525:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602507.981529:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981536:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981549:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602507.981552:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602507.981556:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981561:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af472dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981585:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981599:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981605:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981610:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602507.981613:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981619:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981626:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48ace300) 00010000:00010000:0.0:1787602507.981629:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602507.981631:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981637:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af472e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981685:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff8d expref: 38 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981701:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff8d expref: 37 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602507.981709:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602507.981711:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602507.981719:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459a00, rc 0) 00000100:00100000:0.0:1787602507.981798:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+37:11378:x1874436821159040:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 885us (1174us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787602507.981806:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 151 00000100:00100000:1.0:1787602507.991952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602507.992068:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821159168 00000100:00100000:2.0:1787602507.992081:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821159168 00000100:00100000:2.0:1787602507.992159:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 152 00000100:00100000:2.0:1787602507.992171:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+37:11378:x1874436821159168:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:2.0:1787602507.992387:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af472f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.992411:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af472f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.992423:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af472f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.992467:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af472f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.992475:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af472f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.992483:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af472f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.992490:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602507.992496:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af472f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.992524:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af472f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.992539:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602507.992542:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602507.992547:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af472f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602507.992553:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af472f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602507.993531:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+37:11378:x1874436821159168:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 1356us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602507.993544:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 152 00000100:00100000:3.0:1787602507.995986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602507.996412:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821159424 00000100:00100000:0.0:1787602507.996424:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821159424 00000100:00100000:0.0:1787602507.996507:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 41 00000100:00100000:0.0:1787602507.996518:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+37:11378:x1874436821159424:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602507.996842:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+38:11378:x1874436821159424:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 324us (868us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787602507.996850:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 41 00010000:00010000:2.0:1787602508.254441:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602508.351253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602508.351736:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821159680 00000100:00100000:0.0:1787602508.351749:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821159680 00000100:00100000:0.0:1787602508.351816:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 153 00000100:00100000:0.0:1787602508.351826:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+38:11409:x1874436821159680:12345-192.168.206.25@tcp:101:cat.0 00010000:00010000:0.0:1787602508.351855:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602508.351878:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff94 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.352005:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47306 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.352021:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.352033:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602508.352085:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787602508.352239:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af472ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff94 expref: 41 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.352259:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff94 expref: 40 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.352269:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602508.352272:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602508.352275:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458000, rc 0) 00000100:00100000:0.0:1787602508.352346:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:11409:x1874436821159680:12345-192.168.206.25@tcp:101:cat.0 Request processed in 521us (1106us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787602508.352353:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 153 00000100:00100000:2.0:1787602508.355674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602508.355758:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821160064 00000100:00100000:0.0:1787602508.355771:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821160064 00000100:00100000:0.0:1787602508.355835:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 42 00000100:00100000:0.0:1787602508.355846:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:11409:x1874436821160064:12345-192.168.206.25@tcp:35:cat.0 00000100:00100000:0.0:1787602508.356169:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+41:11409:x1874436821160064:12345-192.168.206.25@tcp:35:cat.0 Request processed in 323us (506us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787602508.356177:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 42 00000100:00100000:1.0:1787602508.358627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602508.358712:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821159808 00000100:00100000:3.0:1787602508.358726:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821159808 00000100:00100000:3.0:1787602508.358807:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:3.0:1787602508.358819:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+41:2362:x1874436821159808:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602508.358837:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602508.358867:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47306 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff94 expref: 41 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602508.358891:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602508.358897:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602508.359021:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:2362:x1874436821159808:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 205us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.359030:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:2.0:1787602508.426924:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602508.427070:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821160320 00000100:00100000:0.0:1787602508.427083:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821160320 00000100:00100000:0.0:1787602508.427154:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 154 00000100:00100000:0.0:1787602508.427166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:11415:x1874436821160320:12345-192.168.206.25@tcp:101:dd.0 00010000:00010000:0.0:1787602508.427199:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602508.427203:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787602508.427237:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af4726c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff6a expref: 40 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.427284:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602508.427290:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602508.427305:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47314 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ff9b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.427448:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.427466:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff8d expref: 40 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.427475:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.427516:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff8d expref: 40 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.427531:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff8d expref: 40 pid: 9459 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602508.427548:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838985856:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602508.427670:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b2d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602508.431687:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838985856:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602508.431726:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.433364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602508.433521:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821160448 00000100:00100000:0.0:1787602508.433553:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821160448 00010000:00010000:0.0:1787602508.433602:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff8d expref: 41 pid: 9459 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602508.433659:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 66 00000100:00100000:0.0:1787602508.433670:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+41:2361:x1874436821160448:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602508.433687:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602508.433694:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff8d expref: 41 pid: 9459 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.433708:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff8d expref: 41 pid: 9459 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.433733:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af472ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff8d expref: 41 pid: 9459 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.433753:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602508.433758:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.433768:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.433777:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.433811:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602508.433872:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:2361:x1874436821160448:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 203us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602508.433889:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 66 00010000:00010000:1.0:1787602508.434014:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.434023:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602508.434069:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787602508.434262:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47314 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff9b expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.434278:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff9b expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.434296:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602508.434300:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787602508.434303:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459e00, rc 0) 00000100:00100000:1.0:1787602508.434337:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:11415:x1874436821160320:12345-192.168.206.25@tcp:101:dd.0 Request processed in 7174us (7428us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787602508.434344:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 154 00000100:00100000:2.0:1787602508.438136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602508.438242:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821160704 00000100:00100000:0.0:1787602508.438257:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821160704 00000100:00100000:0.0:1787602508.438337:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 155 00000100:00100000:0.0:1787602508.438362:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:11415:x1874436821160704:12345-192.168.206.25@tcp:36:dd.0 00010000:00010000:0.0:1787602508.438715:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.438736:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.438749:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787602508.438808:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787602508.438834:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000490a7b3d reply state 0000000081303ce5 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602508.438844:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602508.438947:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+43:11415:x1874436821160704:12345-192.168.206.25@tcp:36:dd.0 Request processed in 598us (825us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787602508.438954:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 155 00000020:00080000:0.0:1787602508.438959:0:9459:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787602508.442191:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.442213:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.442222:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.442229:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602508.442235:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.442261:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.442282:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602508.442285:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602508.442300:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.442306:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47329 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.704628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602508.704786:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821160832 00000100:00100000:1.0:1787602508.704799:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821160832 00000100:00100000:1.0:1787602508.704876:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 156 00000100:00100000:1.0:1787602508.704889:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a46250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+42:11429:x1874436821160832:12345-192.168.206.25@tcp:101:stat.0 00010000:00010000:1.0:1787602508.704922:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602508.704948:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47330 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffa2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705080:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47337 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705097:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705110:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705148:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4733e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705156:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4733e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705162:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4733e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705277:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705288:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff9b expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705302:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705348:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff9b expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.705377:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff9b expref: 43 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602508.705393:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838985984:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602508.705657:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a57d6c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787602508.710810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602508.710978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821161088 00000100:00100000:0.0:1787602508.711002:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821161088 00000100:00100000:0.0:1787602508.711148:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00100000:0.0:1787602508.711161:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+44:5598:x1874436821161088:12345-192.168.206.25@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787602508.711834:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+45:5598:x1874436821161088:12345-192.168.206.25@tcp:35:ldlm_bl.0 Request processed in 672us (1035us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787602508.711854:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00100000:1.0:1787602508.712785:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838985984:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602508.712830:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.715960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602508.716257:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821161216 00000100:00100000:0.0:1787602508.716269:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821161216 00010000:00010000:0.0:1787602508.722714:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff9b expref: 45 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602508.722789:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 67 00000100:00100000:0.0:1787602508.722804:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+45:2362:x1874436821161216:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602508.722823:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602508.722831:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff9b expref: 45 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.722847:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff9b expref: 45 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.722873:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4731b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff9b expref: 45 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.722892:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602508.722898:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.722908:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.722915:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.722973:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602508.723086:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+44:2362:x1874436821161216:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 286us (7140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602508.723095:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 67 00010000:00010000:1.0:1787602508.723865:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.723878:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602508.723933:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787602508.723938:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602508.723965:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.723981:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724002:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724009:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47337 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724016:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47337 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724023:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602508.724028:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47337 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724072:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47337 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724086:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:1.0:1787602508.724098:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602508.724103:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47337 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724110:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47337 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724123:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4733e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724129:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4733e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724136:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4733e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724141:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602508.724144:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4733e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724150:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4733e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724156:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a43b20400) 00010000:00010000:1.0:1787602508.724158:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602508.724161:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4733e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724166:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4733e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724209:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47330 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa2 expref: 44 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724234:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa2 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.724241:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602508.724244:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602508.724246:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c400, rc 0) 00000100:00100000:1.0:1787602508.724743:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a46250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+43:11429:x1874436821160832:12345-192.168.206.25@tcp:101:stat.0 Request processed in 19851us (20123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602508.724754:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 156 00000100:00100000:2.0:1787602508.774760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602508.774863:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821161472 00000100:00100000:0.0:1787602508.774877:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821161472 00000100:00100000:0.0:1787602508.774947:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 157 00000100:00100000:0.0:1787602508.774964:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+43:11435:x1874436821161472:12345-192.168.206.25@tcp:36:truncate.0 00010000:00010000:0.0:1787602508.775661:0:9459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602508.775698:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47345 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa2 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.775722:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602508.775728:0:9459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602508.776102:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.776118:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.776129:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787602508.776275:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787602508.776307:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b98bd417 reply state 0000000061c90ecf transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602508.776316:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602508.776736:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+45:11435:x1874436821161472:12345-192.168.206.25@tcp:36:truncate.0 Request processed in 1771us (1987us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787602508.776746:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 157 00000020:00080000:0.0:1787602508.776753:0:9459:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787602508.778845:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.778865:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.778874:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.778881:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602508.778886:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.778894:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.778912:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602508.778931:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602508.778937:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.778944:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af4734c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.922255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602508.922395:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821161600 00000100:00100000:0.0:1787602508.922408:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821161600 00000100:00100000:0.0:1787602508.922533:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 158 00000100:00100000:0.0:1787602508.922546:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+44:11449:x1874436821161600:12345-192.168.206.25@tcp:101:stat.0 00010000:00010000:0.0:1787602508.922585:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602508.922609:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47353 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffa9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.922686:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af4735a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.922702:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af4735a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.922717:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af4735a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.922732:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47361 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.922739:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.922746:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.922854:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.922888:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.922896:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602508.922937:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787602508.922941:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602508.922963:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.922975:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923680:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af4735a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923691:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af4735a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923698:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af4735a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923705:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602508.923710:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af4735a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923718:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af4735a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923734:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602508.923747:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602508.923753:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af4735a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923760:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af4735a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923775:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923781:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47361 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923787:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923792:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602508.923795:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923801:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923808:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48ace300) 00010000:00010000:0.0:1787602508.923810:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602508.923812:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47361 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923817:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47361 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923917:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47353 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa9 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923948:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa9 expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.923956:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602508.923959:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602508.923961:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459800, rc 0) 00000100:00100000:0.0:1787602508.924172:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+45:11449:x1874436821161600:12345-192.168.206.25@tcp:101:stat.0 Request processed in 1626us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602508.924181:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 158 00000100:00100000:1.0:1787602509.002281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602509.002383:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821161856 00000100:00100000:3.0:1787602509.002396:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821161856 00000100:00100000:3.0:1787602509.002509:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 159 00000100:00100000:3.0:1787602509.002525:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+45:11459:x1874436821161856:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602509.002572:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602509.002600:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4736f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffb0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602509.002955:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000100:00080000:0.0:1787602509.003495:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602509.003849:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4736f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb0 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.003869:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88500) 00010000:00010000:2.0:1787602509.003872:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602509.003877:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4736f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb0 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.004143:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71000, rc 0) 00000100:00100000:2.0:1787602509.004288:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+46:11459:x1874436821161856:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1760us (2014us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787602509.004298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 159 00000100:00100000:2.0:1787602509.007014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602509.007111:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821162112 00000100:00100000:0.0:1787602509.007123:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821162112 00000100:00100000:0.0:1787602509.007198:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 44 00000100:00100000:0.0:1787602509.007212:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a50588450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+46:11459:x1874436821162112:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602509.008147:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a50588450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:11459:x1874436821162112:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 933us (1142us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787602509.008158:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 44 00000100:00100000:2.0:1787602509.075592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602509.075883:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821162368 00000100:00100000:1.0:1787602509.075896:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821162368 00000100:00100000:1.0:1787602509.075974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 160 00000100:00100000:1.0:1787602509.075987:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:11465:x1874436821162368:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602509.076020:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602509.076088:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4737d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffb7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.076218:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.076236:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa9 expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.076248:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.076334:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa9 expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.076350:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa9 expref: 48 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602509.076367:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838986112:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602509.076498:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a57d6c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787602509.080260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602509.080573:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821162496 00000100:00100000:0.0:1787602509.080585:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821162496 00010000:00010000:0.0:1787602509.080638:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa9 expref: 49 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602509.080690:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 68 00000100:00100000:0.0:1787602509.080702:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+49:2361:x1874436821162496:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602509.080719:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602509.080951:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa9 expref: 49 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.080968:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa9 expref: 49 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.080996:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602509.081002:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.081014:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.081022:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.081073:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602509.081142:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+49:2361:x1874436821162496:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 442us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602509.081150:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 68 00010000:00010000:1.0:1787602509.083180:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47368 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffa9 expref: 48 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602509.083211:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838986112:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602509.083242:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.083254:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.083261:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602509.083295:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787602509.083502:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4737d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb7 expref: 49 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.083522:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb7 expref: 48 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.084446:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602509.084449:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787602509.084454:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c200, rc 0) 00000100:00100000:1.0:1787602509.084732:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+48:11465:x1874436821162368:12345-192.168.206.25@tcp:101:bash.0 Request processed in 8744us (9150us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787602509.084753:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 160 00000100:00100000:2.0:1787602509.094729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602509.094846:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821162752 00000100:00100000:1.0:1787602509.094861:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821162752 00000100:00100000:1.0:1787602509.094934:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 161 00000100:00100000:1.0:1787602509.094947:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+48:11465:x1874436821162752:12345-192.168.206.25@tcp:36:bash.0 00010000:00010000:1.0:1787602509.095357:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.095378:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.095391:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602509.095468:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1787602509.095497:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e766ac7 reply state 00000000d54a3dcd transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602509.095508:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602509.095630:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:11465:x1874436821162752:12345-192.168.206.25@tcp:36:bash.0 Request processed in 683us (914us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787602509.095638:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 161 00000020:00080000:1.0:1787602509.095662:0:9459:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787602509.098403:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.098435:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.098467:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.098474:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ce00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602509.098480:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.098489:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.098510:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602509.098514:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602509.098520:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.098527:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47392 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602509.114163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602509.114663:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821162880 00000100:00100000:0.0:1787602509.114677:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821162880 00000100:00100000:0.0:1787602509.114763:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 162 00000100:00100000:0.0:1787602509.114777:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:11465:x1874436821162880:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:0.0:1787602509.114811:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602509.114838:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47399 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffbe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.114945:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.114980:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb7 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.114991:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.115033:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb7 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.115080:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb7 expref: 51 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602509.115097:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838986240:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602509.115206:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b2d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787602509.119785:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838986240:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602509.119824:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602509.123020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602509.126725:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821163008 00000100:00100000:0.0:1787602509.126758:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821163008 00010000:00010000:0.0:1787602509.126831:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb7 expref: 52 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602509.126893:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 69 00000100:00100000:0.0:1787602509.126905:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:2362:x1874436821163008:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602509.126924:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602509.126949:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb7 expref: 52 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.126963:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb7 expref: 52 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.126990:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47384 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffb7 expref: 52 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.127012:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602509.127019:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.127029:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.127097:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.127134:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602509.127211:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:2362:x1874436821163008:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 307us (4211us total) trans 0 rc 0/0 00010000:00010000:2.0:1787602509.127218:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602509.127219:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 69 00010000:00010000:2.0:1787602509.127226:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602509.127285:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787602509.127291:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602509.127315:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.127441:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47399 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffbe expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.127461:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffbe expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602509.127469:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602509.127472:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602509.127474:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458400, rc 0) 00000100:00100000:2.0:1787602509.127505:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:11465:x1874436821162880:12345-192.168.206.25@tcp:101:bash.0 Request processed in 12731us (13360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602509.127511:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 162 00000100:00100000:3.0:1787602509.132910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602509.133085:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821163264 00000100:00100000:1.0:1787602509.133099:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821163264 00000100:00100000:1.0:1787602509.133173:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:1.0:1787602509.133186:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:11465:x1874436821163264:12345-192.168.206.25@tcp:35:bash.0 00000100:00100000:1.0:1787602509.133496:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:11465:x1874436821163264:12345-192.168.206.25@tcp:35:bash.0 Request processed in 312us (601us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787602509.133504:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:3.0:1787602509.217181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602509.217473:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821163520 00000100:00100000:1.0:1787602509.217486:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821163520 00000100:00100000:1.0:1787602509.217562:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 163 00000100:00100000:1.0:1787602509.217575:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:11475:x1874436821163520:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602509.217607:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602509.217633:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af473a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffc5 expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602509.217781:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787602509.217928:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af473a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffc5 expref: 53 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.217944:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88500) 00010000:00010000:1.0:1787602509.217947:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602509.217953:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af473a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffc5 expref: 53 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.217968:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d800, rc 0) 00000100:00100000:1.0:1787602509.218498:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:11475:x1874436821163520:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 922us (1329us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1787602509.218529:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 163 00000100:00100000:2.0:1787602509.221910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602509.222002:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821163648 00000100:00100000:1.0:1787602509.222016:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821163648 00000100:00100000:1.0:1787602509.222108:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 164 00000100:00100000:1.0:1787602509.222121:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:11475:x1874436821163648:12345-192.168.206.25@tcp:34:lfs.0 00010000:00010000:1.0:1787602509.222213:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222234:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222247:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222264:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222272:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222279:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222506:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222517:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222525:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602509.222594:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222610:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222617:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222625:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222631:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602509.222636:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222643:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222657:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:1.0:1787602509.222660:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602509.222665:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222671:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222686:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222692:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222705:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222710:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602509.222713:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222719:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222728:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a43b20400) 00010000:00010000:1.0:1787602509.222731:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602509.222733:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222739:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222756:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222762:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222768:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222773:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ce00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602509.222775:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222792:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222801:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602509.222803:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602509.222806:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.222811:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602509.222903:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:11475:x1874436821163648:12345-192.168.206.25@tcp:34:lfs.0 Request processed in 783us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602509.222913:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 164 00000100:00100000:3.0:1787602509.228905:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602509.229012:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821163904 00000100:00100000:1.0:1787602509.229029:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821163904 00000100:00100000:1.0:1787602509.229267:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 46 00000100:00100000:1.0:1787602509.229289:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:11475:x1874436821163904:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:1.0:1787602509.229623:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:11475:x1874436821163904:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 344us (730us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787602509.229631:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 46 00000100:00100000:3.0:1787602509.260251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602509.260477:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821164160 00000100:00100000:1.0:1787602509.260490:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821164160 00000100:00100000:1.0:1787602509.260563:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 165 00000100:00100000:1.0:1787602509.260576:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+53:11478:x1874436821164160:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602509.260607:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602509.260632:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffcc expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.260758:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.260775:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.260787:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.260802:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.260808:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.260815:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.260975:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af473df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.260985:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af473df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.260991:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af473df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602509.261001:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787602509.261647:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.261658:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.261677:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.261684:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602509.261690:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.261698:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.261714:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:1.0:1787602509.261718:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602509.261723:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.261729:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af473d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.261982:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.261998:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.262005:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.262010:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602509.262014:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.262032:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.262150:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a43b20400) 00010000:00010000:1.0:1787602509.262153:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602509.262156:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.262162:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af473d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.262233:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffcc expref: 56 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.262249:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af473df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffcc expref: 55 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.262257:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602509.262260:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602509.262262:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d800, rc 0) 00000100:00100000:1.0:1787602509.262384:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:11478:x1874436821164160:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1809us (2145us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787602509.263974:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 165 00000100:00100000:2.0:1787602509.268827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602509.268926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602509.269116:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821164288 00000100:00100000:1.0:1787602509.269128:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821164288 00000100:00100000:1.0:1787602509.269200:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 166 00000100:00100000:1.0:1787602509.269214:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:11478:x1874436821164288:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:1.0:1787602509.269349:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.269377:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.269555:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.269592:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.269600:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.269607:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.269613:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602509.269618:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.269626:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.269640:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602509.269643:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602509.269649:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.269655:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602509.269833:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:11478:x1874436821164288:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 621us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602509.269841:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 166 00000100:00100000:3.0:1787602509.270183:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821164416 00000100:00100000:3.0:1787602509.270190:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821164416 00000100:00100000:3.0:1787602509.270237:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00100000:3.0:1787602509.270246:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:2361:x1874436821164416:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602509.270258:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602509.270276:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af473df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffcc expref: 55 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602509.270555:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602509.270559:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602509.270590:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:2361:x1874436821164416:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 346us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602509.270597:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00100000:3.0:1787602509.274898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602509.275088:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821164672 00000100:00100000:0.0:1787602509.275102:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821164672 00000100:00100000:0.0:1787602509.275165:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00100000:0.0:1787602509.275177:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:11478:x1874436821164672:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602509.275658:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:11478:x1874436821164672:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 482us (774us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787602509.275686:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 47 00010000:00010000:2.0:1787602509.277231:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602509.426716:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602509.426831:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821164928 00000100:00100000:1.0:1787602509.426844:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821164928 00000100:00100000:1.0:1787602509.426917:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 167 00000100:00100000:1.0:1787602509.426930:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:11496:x1874436821164928:12345-192.168.206.25@tcp:101:cat.0 00010000:00010000:1.0:1787602509.426960:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602509.426985:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffd3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.427143:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.427160:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.427172:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602509.427184:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787602509.427506:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af473f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffd3 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.427528:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffd3 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.427538:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602509.427558:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787602509.427562:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011ce00, rc 0) 00000100:00100000:1.0:1787602509.427640:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11496:x1874436821164928:12345-192.168.206.25@tcp:101:cat.0 Request processed in 713us (938us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787602509.427648:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 167 00000100:00100000:2.0:1787602509.464227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602509.464365:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821165056 00000100:00100000:0.0:1787602509.464377:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821165056 00000100:00100000:0.0:1787602509.464456:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 168 00000100:00100000:0.0:1787602509.464467:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11497:x1874436821165056:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602509.464705:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602509.464732:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffda expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.464820:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458200/0x576b7af90af47410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.464837:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458200/0x576b7af90af47410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.464851:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458200/0x576b7af90af47410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602509.464921:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787602509.464925:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602509.465085:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458200/0x576b7af90af47410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.465415:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffda expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.465456:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458200/0x576b7af90af47410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffda expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.465556:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602509.465559:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602509.465563:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458200, rc 0) 00000100:00100000:0.0:1787602509.465943:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11497:x1874436821165056:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1476us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602509.465955:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 168 00000100:00100000:3.0:1787602509.471401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602509.471814:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821165440 00000100:00100000:2.0:1787602509.471827:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821165440 00000100:00100000:2.0:1787602509.471902:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 48 00000100:00100000:2.0:1787602509.471915:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11497:x1874436821165440:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:2.0:1787602509.472656:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11497:x1874436821165440:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 740us (1267us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787602509.472667:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 48 00000100:00100000:2.0:1787602509.480881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602509.481092:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821165568 00000100:00100000:0.0:1787602509.481105:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821165568 00000100:00100000:0.0:1787602509.481189:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:0.0:1787602509.481203:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11497:x1874436821165568:12345-192.168.206.25@tcp:103:lfs.0 00010000:00010000:0.0:1787602509.481222:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787602509.481255:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af473a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffbe expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.481294:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af473fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffd3 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.481310:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af472ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff7f expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.481321:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602509.481344:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602509.481420:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:11497:x1874436821165568:12345-192.168.206.25@tcp:103:lfs.0 Request processed in 220us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602509.481437:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:3.0:1787602509.485196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602509.485531:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821165696 00000100:00100000:0.0:1787602509.485544:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821165696 00000100:00100000:0.0:1787602509.485614:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 169 00000100:00100000:0.0:1787602509.485628:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:11497:x1874436821165696:12345-192.168.206.25@tcp:58:lfs.0 00010000:00010000:0.0:1787602509.485797:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47417 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.485816:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47417 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.485829:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47417 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602509.486125:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787602509.486234:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:11497:x1874436821165696:12345-192.168.206.25@tcp:58:lfs.0 Request processed in 608us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602509.486243:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 169 00000100:00100000:3.0:1787602509.516322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602509.516990:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821165824 00000100:00100000:1.0:1787602509.517003:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821165824 00000100:00100000:1.0:1787602509.517115:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 170 00000100:00100000:1.0:1787602509.517128:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:11499:x1874436821165824:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602509.517156:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602509.517183:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af4741e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffe1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.517273:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47425 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.517302:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.517315:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.517332:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4742c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.517340:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4742c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.517346:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4742c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.517793:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.517803:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.517811:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602509.517857:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787602509.517936:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602509.517964:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518510:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518529:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518537:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47425 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518544:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518551:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602509.518556:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518565:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47425 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518593:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:1.0:1787602509.518596:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602509.518601:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47425 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518607:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af47425 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518623:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4742c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518629:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4742c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518635:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4742c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518641:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602509.518644:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4742c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518650:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4742c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518657:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a43b20400) 00010000:00010000:1.0:1787602509.518659:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602509.518662:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4742c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518667:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af4742c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518727:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af4741e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe1 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518744:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe1 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.518752:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48ace300) 00010000:00010000:1.0:1787602509.518754:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602509.518756:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d600, rc 0) 00000100:00100000:1.0:1787602509.518993:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11499:x1874436821165824:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1857us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602509.519004:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 170 00010000:00010000:2.0:1787602510.304552:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602510.366929:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602510.366959:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838986368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602510.367080:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602510.367206:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838986368 00000100:00100000:2.0:1787602510.367216:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838986368 00000100:00100000:2.0:1787602510.367313:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787602510.367335:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838986368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602510.367378:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602510.367439:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838986368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602510.367447:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787602510.367808:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602510.367857:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e55ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838986368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602510.372818:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838986624:0@lo:400:kworker.0 00000100:00100000:0.0:1787602510.372907:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602510.372969:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787602510.372986:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838986496:0@lo:400:kworker.0 00000100:00100000:0.0:1787602510.373021:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602510.373069:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838987008:0@lo:400:kworker.0 00000100:00100000:0.0:1787602510.373119:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602510.373159:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838986624 00000100:00100000:0.0:1787602510.373168:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838986624 00000100:00100000:0.0:1787602510.373220:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838987008 00000100:00100000:0.0:1787602510.373223:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838987008 00000100:00100000:0.0:1787602510.373254:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787602510.373263:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838986624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602510.373659:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838986624:12345-0@lo:400:kworker.0 Request processed in 396us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602510.373667:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787602510.373688:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787602510.373695:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838987008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602510.373723:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838987008:12345-0@lo:400:kworker.0 Request processed in 28us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602510.373729:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787602510.373750:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838986496 00000100:00100000:0.0:1787602510.373754:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838986496 00000100:00100000:0.0:1787602510.373782:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787602510.373788:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838986496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602510.373818:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838986496:12345-0@lo:400:kworker.0 Request processed in 30us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602510.373824:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787602510.373869:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838986880:0@lo:400:kworker.0 00000100:00100000:0.0:1787602510.373898:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602510.373923:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602510.373929:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838986752:0@lo:400:kworker.0 00000100:00100000:0.0:1787602510.373963:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602510.374488:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838986880 00000100:00100000:0.0:1787602510.374495:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838986880 00000100:00100000:0.0:1787602510.374583:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787602510.374593:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838986880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602510.374653:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838986880:12345-0@lo:400:kworker.0 Request processed in 62us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602510.374659:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787602510.374728:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787602510.374735:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787602510.374765:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c62f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838986880:0@lo:400:kworker.0 00000100:00080000:1.0:1787602510.380608:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602510.380621:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602510.382262:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838986496:0@lo:400:kworker.0 00000100:00100000:1.0:1787602510.382303:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838987008:0@lo:400:kworker.0 00000100:00100000:1.0:1787602510.382656:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838986624:0@lo:400:kworker.0 00000100:00100000:1.0:1787602510.384525:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838986752 00000100:00100000:1.0:1787602510.384542:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838986752 00000100:00100000:1.0:1787602510.384643:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787602510.384656:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436838986752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602510.384774:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436838986752:12345-0@lo:400:kworker.0 Request processed in 120us (10808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.384782:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787602510.384858:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838986752:0@lo:400:kworker.0 00000100:00080000:1.0:1787602510.384890:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787602510.441601:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787602510.441613:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602510.441687:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:2.0:1787602510.441695:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787602510.441858:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e55f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838987136:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787602510.441975:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d3293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602510.459030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.459215:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e55f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838987136:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787602510.459757:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821165952 00000100:00100000:1.0:1787602510.459768:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821165952 00000100:00100000:1.0:1787602510.459842:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 171 00000100:00100000:1.0:1787602510.459854:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11511:x1874436821165952:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787602510.459898:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787602510.461264:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11511:x1874436821165952:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 1398us (2237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.461287:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 171 00000100:00100000:3.0:1787602510.479031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.479093:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821166080 00000100:00100000:3.0:1787602510.479523:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821166080 00000100:00100000:3.0:1787602510.479597:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 172 00000100:00100000:3.0:1787602510.479609:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11511:x1874436821166080:12345-192.168.206.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787602510.479702:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af4743a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.479724:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af4743a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.479737:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af4743a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485279:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47441 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485391:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47441 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485407:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47441 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485459:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485469:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485476:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602510.485525:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787602510.485529:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602510.485550:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485564:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af4743a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485571:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af4743a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485579:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af4743a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485585:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602510.485590:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af4743a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485598:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af4743a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485611:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:3.0:1787602510.485613:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602510.485617:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af4743a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485623:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af4743a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485634:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47441 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485640:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47441 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485647:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47441 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485656:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602510.485659:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47441 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485665:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47441 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485671:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff944a58b88400) 00010000:00010000:3.0:1787602510.485674:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602510.485676:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47441 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485682:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47441 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485695:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485700:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485705:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485710:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602510.485712:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485718:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485733:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48ace300) 00010000:00010000:3.0:1787602510.485735:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602510.485738:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.485744:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af47448 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602510.485851:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11511:x1874436821166080:12345-192.168.206.25@tcp:34:lhsmtool_posix.0 Request processed in 6237us (6826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602510.485861:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 172 00000100:00100000:3.0:1787602510.491204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602510.491738:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821166336 00000100:00100000:2.0:1787602510.491751:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821166336 00000100:00100000:2.0:1787602510.491828:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 173 00000100:00100000:2.0:1787602510.491841:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11511:x1874436821166336:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602510.491868:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602510.491892:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4744f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffe8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492168:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492187:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492213:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602510.492227:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787602510.492465:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492473:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47456 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492480:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492487:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602510.492492:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492500:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47456 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492514:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48ace300) 00010000:00010000:2.0:1787602510.492517:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602510.492523:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47456 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492529:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492578:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4744f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe8 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492733:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:2.0:1787602510.492735:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602510.492740:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4744f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe8 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.492751:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477e00, rc 0) 00000100:00100000:2.0:1787602510.492826:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11511:x1874436821166336:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 987us (1635us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787602510.492834:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 173 00000100:00100000:2.0:1787602510.496235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602510.497538:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821166464 00000100:00100000:1.0:1787602510.497553:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821166464 00000100:00100000:1.0:1787602510.497625:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 174 00000100:00100000:1.0:1787602510.497637:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11511:x1874436821166464:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787602510.497687:0:9459:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787602510.497827:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11511:x1874436821166464:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 191us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.497836:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 174 00000100:00100000:3.0:1787602510.505583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602510.505743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821166720 00000100:00100000:0.0:1787602510.505756:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821166720 00000100:00100000:0.0:1787602510.505834:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 175 00000100:00100000:0.0:1787602510.505846:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11511:x1874436821166720:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602510.505873:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602510.505877:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787602510.505912:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458200/0x576b7af90af47410 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffda expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.505935:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602510.505941:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602510.505957:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af47464 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234ffef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602510.511617:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787602510.511892:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af4746b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.511913:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af4746b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.511927:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af4746b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.512183:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af47464 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffef expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.512206:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af4746b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffef expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.512216:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a43b20400) 00010000:00010000:1.0:1787602510.512219:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602510.512223:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c600, rc 0) 00000100:00100000:1.0:1787602510.512553:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11511:x1874436821166720:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 6706us (6983us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787602510.512564:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 175 00000100:00100000:1.0:1787602510.519836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602510.522653:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821166976 00000100:00100000:2.0:1787602510.522672:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821166976 00000100:00100000:2.0:1787602510.522755:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 176 00000100:00100000:2.0:1787602510.522769:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11511:x1874436821166976:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787602510.522846:0:9459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602510.522878:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af4746b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffef expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.522897:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a43b20400) 00010000:00010000:2.0:1787602510.522908:0:9459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602510.522935:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47479 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.522950:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47479 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.522985:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47479 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.525783:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af47480 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x857e7c18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.525809:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af47480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x857e7c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.525823:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af47480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x857e7c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.525973:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47479 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.525981:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47479 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.525989:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47479 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.525994:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602510.525999:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47479 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.526007:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47479 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.526019:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602510.526022:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602510.526027:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47479 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.526073:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47479 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.526088:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af47480 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x857e7c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.526094:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af47480 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x857e7c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.526100:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af47480 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x857e7c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.526105:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602510.526108:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af47480 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x857e7c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.526113:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af47480 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x857e7c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.526121:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x857e7c18 (ffff944a48947500) 00010000:00010000:2.0:1787602510.526123:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602510.526126:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af47480 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x857e7c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.526132:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af47480 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x857e7c18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602510.526310:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11511:x1874436821166976:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 3540us (6483us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787602510.526320:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 176 00000040:00080000:1.0:1787602510.530867:0:12464:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602510.530881:0:12464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602510.530936:0:12464:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:1.0:1787602510.530945:0:12464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787602510.539372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602510.540333:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821167104 00000100:00100000:0.0:1787602510.540349:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821167104 00000100:00100000:0.0:1787602510.540441:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 177 00000100:00100000:0.0:1787602510.540455:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11511:x1874436821167104:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602510.540483:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602510.540527:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458200/0x576b7af90af47487 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fff6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.540571:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.540586:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.540609:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.540726:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458200/0x576b7af90af47487 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fff6 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.540749:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fff6 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.540759:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a48acef00) 00010000:00010000:0.0:1787602510.540762:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787602510.540766:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458a00, rc 0) 00000100:00100000:0.0:1787602510.540845:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11511:x1874436821167104:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 393us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602510.540852:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 177 00000100:00100000:2.0:1787602510.554712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602510.554838:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821167360 00000100:00100000:1.0:1787602510.554852:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821167360 00000100:00100000:1.0:1787602510.554923:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 178 00000100:00100000:1.0:1787602510.554935:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11511:x1874436821167360:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787602510.555069:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.555090:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.555130:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602510.555846:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1787602510.555859:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341661821773ns, next at 342661818774ns, rc = 0 00000004:00010000:1.0:1787602510.555987:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000133ca2e8 reply state 00000000fbef9a33 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602510.555998:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602510.556659:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11511:x1874436821167360:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 1722us (1957us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787602510.556670:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 178 00010000:00010000:2.0:1787602510.573764:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.573804:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.573820:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.573834:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011cc00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602510.573843:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.573857:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.573889:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a48acef00) 00010000:00010000:2.0:1787602510.573893:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787602510.573901:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.573907:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47495 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602510.578063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.582150:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821167488 00000100:00100000:3.0:1787602510.582175:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821167488 00000100:00100000:3.0:1787602510.582283:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 179 00000100:00100000:3.0:1787602510.582297:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:11511:x1874436821167488:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602510.582329:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602510.582371:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4749c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1234fffd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.582644:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4749c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fffd expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.582663:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4749c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fffd expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.582706:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a48acef00) 00010000:00010000:3.0:1787602510.582710:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602510.582714:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71e00, rc 0) 00000100:00100000:3.0:1787602510.582801:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11511:x1874436821167488:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 506us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602510.582809:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 179 00000100:00100000:1.0:1787602510.592247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602510.592408:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821167616 00000100:00100000:2.0:1787602510.592430:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821167616 00000100:00100000:2.0:1787602510.592518:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 50 00000100:00100000:2.0:1787602510.592531:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821167616:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787602510.593270:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602510.593567:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821167616:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 Request processed in 1034us (1340us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787602510.593579:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 50 00000100:00100000:2.0:1787602510.599869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602510.600484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602510.600521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.600992:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821168128 00000100:00100000:3.0:1787602510.601016:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821168128 00000100:00100000:3.0:1787602510.601321:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:3.0:1787602510.601336:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11511:x1874436821168128:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787602510.601897:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+62:11511:x1874436821168128:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 562us (1371us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787602510.601908:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:3.0:1787602510.602087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602510.604400:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821167872 00000100:00100000:0.0:1787602510.604431:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821167872 00000100:00100000:0.0:1787602510.604516:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 70 00000100:00100000:0.0:1787602510.604528:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821167872:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602510.604623:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821167872:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 97us (4141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602510.604641:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 70 00000100:00100000:1.0:1787602510.604855:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821167744 00000100:00100000:1.0:1787602510.604860:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821167744 00000100:00100000:1.0:1787602510.605005:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 290 00000100:00100000:1.0:1787602510.605014:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821167744:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602510.605065:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821167744:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 53us (5212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.605072:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 290 00000100:00080000:1.0:1787602510.605121:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602510.605795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.607102:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821168256 00000100:00100000:3.0:1787602510.607117:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821168256 00000100:00100000:3.0:1787602510.607191:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821168512 00000100:00100000:3.0:1787602510.607196:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821168512 00000100:00100000:3.0:1787602510.607231:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 135 00000100:00100000:3.0:1787602510.607244:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821168256:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602510.607319:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 180 00000100:00100000:0.0:1787602510.607331:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+62:11511:x1874436821168512:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787602510.607460:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+62:11511:x1874436821168512:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 131us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602510.607467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 180 00000100:00080000:0.0:1787602510.607616:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602510.609773:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2361:x1874436821168256:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 2515us (7669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602510.609791:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 135 00000100:00100000:3.0:1787602510.609896:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.609997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821168640 00000100:00100000:3.0:1787602510.610007:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821168640 00000100:00100000:3.0:1787602510.610078:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 181 00000100:00100000:3.0:1787602510.610088:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+62:11511:x1874436821168640:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602510.610110:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602510.610136:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350004 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.610239:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.610257:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.610269:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602510.610323:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602510.610345:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.610376:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350004 expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.610394:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350004 expref: 63 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.610404:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a48acef00) 00010000:00010000:3.0:1787602510.610407:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787602510.610428:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71200, rc 0) 00000100:00100000:3.0:1787602510.610464:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+63:11511:x1874436821168640:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 377us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602510.610471:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 181 00000100:00100000:0.0:1787602510.614017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602510.614437:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821168768 00000100:00100000:2.0:1787602510.614450:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821168768 00000100:00100000:2.0:1787602510.614532:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00100000:2.0:1787602510.614545:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2364:x1874436821168768:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602510.614568:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602510.615210:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee31f716/0x576b7af90af474b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235000b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602510.615253:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ca64d, blocks: 0x1 00010000:00010000:2.0:1787602510.615445:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1787602510.615451:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602510.615464:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee31f716/0x576b7af90af474b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235000b expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.615487:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee31f716/0x576b7af90af474b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235000b expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.615503:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477800, rc 0) 00000100:00100000:2.0:1787602510.615694:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2364:x1874436821168768:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 1149us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602510.615723:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00100000:0.0:1787602510.625372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.625487:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821169024 00000100:00100000:3.0:1787602510.625500:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821169024 00000100:00100000:3.0:1787602510.625565:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 182 00000100:00100000:3.0:1787602510.625577:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7509c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+63:11511:x1874436821169024:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787602510.625786:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7509c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+63:11511:x1874436821169024:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 209us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602510.625795:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 182 00000100:00100000:3.0:1787602510.632731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602510.632843:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821169152 00000100:00100000:0.0:1787602510.632855:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821169152 00000100:00100000:0.0:1787602510.632931:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00100000:0.0:1787602510.632944:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:11511:x1874436821169152:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602510.632969:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602510.632992:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350012 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.633030:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee31f716/0x576b7af90af474b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235000b expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.633080:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602510.633085:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602510.633092:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 9 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.633692:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee31f716/0x576b7af90af474b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235000b expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.633711:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee31f716/0x576b7af90af474b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235000b expref: 9 pid: 6694 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602510.633731:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1874436838987264:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602510.633846:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b2d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787602510.645990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602510.646318:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1874436838987264:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602510.646363:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 9 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.646410:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458e00, rc 0) 00000100:00100000:1.0:1787602510.646489:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:11511:x1874436821169152:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 13546us (13773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.646499:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00100000:2.0:1787602510.647268:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821169280 00000100:00100000:2.0:1787602510.647280:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821169280 00010000:00010000:2.0:1787602510.647324:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee31f716/0x576b7af90af474b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235000b expref: 9 pid: 6694 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602510.647372:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 70 00000100:00100000:2.0:1787602510.647383:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2362:x1874436821169280:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602510.647402:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602510.647441:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee31f716/0x576b7af90af474b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235000b expref: 9 pid: 6694 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.650158:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee31f716/0x576b7af90af474b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235000b expref: 9 pid: 6694 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.650201:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee31f716/0x576b7af90af474b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235000b expref: 9 pid: 6694 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.650220:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602510.650226:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602510.650237:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 8 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.650255:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 8 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.650338:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 8 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602510.650357:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e55ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5818:1874436838987392:192.168.206.25@tcp:105: 00000100:00100000:2.0:1787602510.650496:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d329780 going to sleep for 11 seconds 00000100:00100000:0.0:1787602510.655998:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602510.656031:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821169408 00000100:00100000:0.0:1787602510.656063:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821169408 00002000:00100000:0.0:1787602510.656133:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff944a6e6b2680 x1874436821169408/t0(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:346/0 lens 504/0 e 0 to 0 dl 1787602521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602510.656146:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a6e6b2680 with x1874436821169408 ext(0->8) 00002000:00010000:0.0:1787602510.656153:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a6e6b2680 00000100:00100000:0.0:1787602510.656183:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:0.0:1787602510.656195:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2361:x1874436821169408:12345-192.168.206.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787602510.656410:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e55ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5818:1874436838987392:192.168.206.25@tcp:105: 00010000:00010000:2.0:1787602510.656449:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602510.656519:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2362:x1874436821169280:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 9135us (10541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602510.656530:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 70 00000100:00100000:0.0:1787602510.657317:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e6b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:2361:x1874436821169408:12345-192.168.206.25@tcp:4:lhsmtool_posix.0 Request processed in 1118us (1322us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787602510.657327:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 4 00002000:00100000:0.0:1787602510.657336:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff944a6e6b2680 x1874436821169408/t4294967314(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:346/0 lens 504/448 e 0 to 0 dl 1787602521 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602510.657361:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a6e6b2680 with x1874436821169408 ext(0->8) 00002000:00010000:0.0:1787602510.657367:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a6e6b2680 00000100:00100000:2.0:1787602510.683013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.683721:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821169536 00000100:00100000:3.0:1787602510.683737:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821169536 00000100:00100000:3.0:1787602510.683820:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 183 00000100:00100000:3.0:1787602510.683839:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+63:11511:x1874436821169536:12345-192.168.206.25@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787602510.753401:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000001:00080000:0.0:1787602510.753459:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1787602510.753464:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787602510.753518:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787602510.753538:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff944a46b92540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787602510.753543:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6e9da800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff944a46b92480 00000020:00080000:0.0:1787602510.753546:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6e9dab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff944a4367e400 00000001:00080000:0.0:1787602510.753574:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:1.0:1787602510.753674:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838987520:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1787602510.753738:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1787602510.753757:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787602510.753947:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787602510.753961:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838987648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787602510.754014:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602510.754216:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+18:11511:x1874436821169536:12345-192.168.206.25@tcp:44:lhsmtool_posix.0 Request processed in 70377us (71213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602510.754230:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 183 00000100:00100000:1.0:1787602510.757020:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838987520 00000100:00100000:1.0:1787602510.757053:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838987520 00000100:00100000:1.0:1787602510.757146:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838987648 00000100:00100000:1.0:1787602510.757150:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838987648 00000100:00100000:1.0:1787602510.757179:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787602510.757191:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838987520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787602510.757538:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787602510.757542:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787602509 00002000:00010000:1.0:1787602510.757544:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787602510.757547:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787602509 -> 1787602509 00002000:00010000:1.0:1787602510.757549:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787602510.757725:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874436838987520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 533us (3965us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787602510.757735:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787602510.757758:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787602510.757766:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838987648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787602510.757786:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1787602510.757817:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8ca64a, atime: 0x6a8ca64a, ctime: 0x6a8ca64a, blocks: 0xb 00010000:00010000:1.0:1787602510.757837:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af474bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.757856:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1787602510.757862:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602510.757869:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af474bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.757887:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af474bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.757899:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af474bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.757906:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af474bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.757926:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787602510.758559:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874436838987648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 792us (4541us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787602510.758567:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1787602510.758853:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a7c2d0e00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787602510.758862:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838987648:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787602510.759112:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602510.759121:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af474bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.759130:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602510.759135:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af474bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.759155:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af474bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.759178:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af474bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.759186:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac7dbe5a/0x576b7af90af474bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.759207:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602510.759209:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602510.759211:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787602510.759239:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944947d6a300/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787602510.759245:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838987520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787602510.761519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602510.761668:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821169664 00000100:00100000:1.0:1787602510.761682:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821169664 00000100:00100000:1.0:1787602510.761754:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 55 00000100:00100000:1.0:1787602510.761766:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:2362:x1874436821169664:12345-192.168.206.25@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787602510.841822:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:1.0:1787602510.841866:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1787602510.842063:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821169664:12345-192.168.206.25@tcp:16:lhsmtool_posix.0 Request processed in 80268us (80526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.842077:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 55 00000100:00100000:2.0:1787602510.850712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.851538:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821169920 00000100:00100000:3.0:1787602510.851554:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821169920 00000100:00100000:3.0:1787602510.851639:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 184 00000100:00100000:3.0:1787602510.851652:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+18:11511:x1874436821169920:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787602510.851726:0:9459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602510.851762:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350004 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.851799:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a48acef00) 00010000:00010000:3.0:1787602510.851805:0:9459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602510.851844:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.851860:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.851871:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602510.852208:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040481f7c reply state 00000000d6120959 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602510.852219:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602510.852544:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:11511:x1874436821169920:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 893us (1846us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787602510.852553:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 184 00010000:00010000:3.0:1787602510.854772:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.854792:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.854800:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.854806:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602510.854812:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.854829:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.854853:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a48acef00) 00010000:00010000:3.0:1787602510.854856:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602510.854861:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.854867:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602510.870288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602510.870430:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821170048 00000100:00100000:1.0:1787602510.870443:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821170048 00000100:00100000:1.0:1787602510.870529:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 56 00000100:00100000:1.0:1787602510.870543:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2363:x1874436821170048:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787602510.870860:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787602510.870865:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787602509 -> 1787602508 00002000:00010000:1.0:1787602510.870867:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787602506 00002000:00010000:1.0:1787602510.870870:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787602509 -> 1787602508 00002000:00010000:1.0:1787602510.870873:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787602510.870950:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2363:x1874436821170048:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 Request processed in 409us (681us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787602510.870960:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 56 00000100:00100000:2.0:1787602510.875169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.875541:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821170304 00000100:00100000:3.0:1787602510.875554:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821170304 00000100:00100000:3.0:1787602510.875638:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 185 00000100:00100000:3.0:1787602510.875651:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+18:11511:x1874436821170304:12345-192.168.206.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787602510.875741:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.875760:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fff6 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.875770:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.875810:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fff6 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.875826:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fff6 expref: 18 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602510.875859:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a60404380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838987776:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602510.877135:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d262f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602510.887723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.887787:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a60404380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838987776:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602510.887822:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602510.888111:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821170432 00000100:00100000:0.0:1787602510.888120:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821170432 00010000:00010000:0.0:1787602510.888166:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fff6 expref: 19 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602510.888205:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 71 00000100:00100000:0.0:1787602510.888216:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:2362:x1874436821170432:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602510.888234:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602510.888259:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fff6 expref: 19 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888282:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fff6 expref: 19 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888309:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458a00/0x576b7af90af4748e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fff6 expref: 19 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888326:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a48acef00) 00010000:00010000:0.0:1787602510.888332:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888342:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888350:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888377:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602510.888449:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+18:2362:x1874436821170432:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 233us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602510.888458:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 71 00010000:00010000:0.0:1787602510.888484:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888492:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888525:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888539:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888547:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888554:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602510.888559:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888567:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888588:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a48acef00) 00010000:00010000:0.0:1787602510.888591:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787602510.888596:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.888602:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af474cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602510.888645:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+17:11511:x1874436821170304:12345-192.168.206.25@tcp:55:lhsmtool_posix.0 Request processed in 12996us (13489us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787602510.888654:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 185 00000100:00100000:0.0:1787602510.892071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602510.892155:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821170560 00000100:00100000:1.0:1787602510.892168:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821170560 00000100:00100000:1.0:1787602510.892228:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 57 00000100:00100000:1.0:1787602510.892241:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2363:x1874436821170560:12345-192.168.206.25@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787602510.892313:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.892338:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 8 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.892347:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602510.892351:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602510.892356:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.892401:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 8 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.892438:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 8 pid: 8475 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602510.892456:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1874436838987904:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602510.892559:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a57d6ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787602510.894836:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1874436838987904:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602510.894875:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602510.895640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602510.896157:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821170688 00000100:00100000:1.0:1787602510.896169:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821170688 00010000:00010000:1.0:1787602510.896223:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 9 pid: 8475 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602510.896269:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 72 00000100:00100000:1.0:1787602510.896365:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2362:x1874436821170688:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602510.896393:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602510.896440:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 9 pid: 8475 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.896459:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 9 pid: 8475 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.896493:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af474b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350012 expref: 9 pid: 8475 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.896515:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1787602510.896521:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602510.896545:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.896558:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.897150:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602510.897224:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2362:x1874436821170688:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 861us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.897234:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 72 00010000:00010000:3.0:1787602510.899394:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.899431:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.899479:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.899488:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.899498:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.899525:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ce00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602510.899531:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.899541:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.899564:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.899571:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af474d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602510.899804:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2363:x1874436821170560:12345-192.168.206.25@tcp:1:lhsmtool_posix.0 Request processed in 7559us (7775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602510.899817:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 57 00000100:00100000:0.0:1787602510.908584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.908871:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821170944 00000100:00100000:3.0:1787602510.908884:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821170944 00000100:00100000:3.0:1787602510.909017:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 186 00000100:00100000:3.0:1787602510.909033:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+17:11511:x1874436821170944:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787602510.909187:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.909207:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.909246:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.909529:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.909542:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4749c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fffd expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.909550:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.909836:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4749c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fffd expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.909856:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4749c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fffd expref: 18 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602510.909875:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a60404380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838988032:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602510.910077:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d262f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.914937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602510.915969:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821171072 00000100:00100000:2.0:1787602510.915996:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821171072 00010000:00010000:2.0:1787602510.916092:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4749c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fffd expref: 19 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602510.916137:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 73 00000100:00100000:2.0:1787602510.916148:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:2362:x1874436821171072:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602510.916166:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602510.916175:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4749c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fffd expref: 19 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.916211:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4749c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fffd expref: 19 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.916241:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a48acef00) 00010000:00010000:2.0:1787602510.916248:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.916260:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.916269:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.916526:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602510.916721:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:2362:x1874436821171072:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 572us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602510.916732:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 73 00010000:00010000:3.0:1787602510.916926:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4749c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fffd expref: 18 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602510.916947:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a60404380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838988032:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602510.916983:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.916993:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.917011:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602510.917295:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787602510.917855:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787602510.917911:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787602510.918013:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a60404380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838988160:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787602510.918123:0:9459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602510.918157:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d262000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.918347:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838988160 00000100:00100000:1.0:1787602510.918492:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838988160 00000100:00100000:1.0:1787602510.918557:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787602510.918568:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9459:x1874436838988160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787602510.918745:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9459:x1874436838988160:12345-0@lo:1000:mdt00_003.0 Request processed in 178us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.918754:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787602510.918856:0:9459:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787602510.918862:0:9459:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944947d6a300, transno 4294967315 00000100:00100000:2.0:1787602510.918884:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a60404380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838988160:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787602510.920099:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787602510.920189:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e948380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838988288:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787602510.920256:0:9459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602510.920525:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47b2d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787602510.921954:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838988288 00000100:00100000:3.0:1787602510.921970:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838988288 00000100:00100000:3.0:1787602510.922372:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602510.922386:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9459:x1874436838988288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787602510.922860:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9459:x1874436838988288:12345-0@lo:1000:mdt00_003.0 Request processed in 475us (2601us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787602510.922870:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787602510.923001:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e948380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838988288:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787602510.923079:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923108:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923117:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923124:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602510.923129:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923138:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923157:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a48acef00) 00010000:00010000:2.0:1787602510.923160:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602510.923167:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923173:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af474e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923210:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47417 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923216:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47417 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923221:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47417 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923226:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602510.923237:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47417 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923244:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47417 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923252:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48ace300) 00010000:00010000:2.0:1787602510.923255:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602510.923257:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47417 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923262:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459200/0x576b7af90af47417 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923432:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923450:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe1 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923460:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923504:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe1 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.923522:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe1 expref: 21 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602510.923538:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e948700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838988416:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602510.923769:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49529480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.927811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602510.928012:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821171200 00000100:00100000:0.0:1787602510.928024:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821171200 00010000:00010000:0.0:1787602510.928134:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe1 expref: 22 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602510.928180:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 74 00000100:00100000:0.0:1787602510.928192:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:2361:x1874436821171200:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602510.928211:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602510.928219:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe1 expref: 22 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.928235:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe1 expref: 22 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.928264:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48ace300) 00010000:00010000:0.0:1787602510.928270:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.928293:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.928301:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.928325:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602510.928397:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:2361:x1874436821171200:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 206us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602510.928405:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 74 00010000:00010000:2.0:1787602510.932366:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47433 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ffe1 expref: 21 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602510.932403:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e948700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838988416:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602510.932443:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.932455:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.932462:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.932479:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.932486:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.932494:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.932500:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602510.932505:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.932513:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.932534:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48ace300) 00010000:00010000:2.0:1787602510.932537:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602510.932567:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.933711:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.933737:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.933744:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.933750:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.933755:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602510.933759:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.933766:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.933780:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48ace300) 00010000:00010000:2.0:1787602510.933783:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787602510.933787:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.933792:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af474db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602510.937968:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:11511:x1874436821170944:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 28922us (29388us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787602510.937996:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 186 00000020:00080000:3.0:1787602510.938005:0:9459:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787602510.942377:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602510.943405:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821171456 00000100:00100000:3.0:1787602510.943431:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821171456 00000100:00100000:3.0:1787602510.943520:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 50 00000100:00100000:3.0:1787602510.943533:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a50588850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:11511:x1874436821171456:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787602510.944406:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787602510.944535:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787602510.944599:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.944618:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.944631:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.944641:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.944648:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.944654:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602510.944676:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787602510.944789:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a50588850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:11511:x1874436821171456:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 1256us (2435us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787602510.944798:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 50 00000020:00080000:3.0:1787602510.944804:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787602510.945140:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602510.945150:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.945158:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71e00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602510.945163:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.945172:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.945195:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff944a58b88400) 00010000:00010000:1.0:1787602510.945199:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787602510.945205:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.945211:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af474f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.945232:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602510.945234:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602510.945236:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787602510.947679:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787602510.947691:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787602510.948231:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787602510.948261:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787602511.326019:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602511.902339:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602511.902368:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944946fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838988544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602511.902531:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602511.902669:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838988544 00000100:00100000:1.0:1787602511.902679:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838988544 00000100:00100000:1.0:1787602511.903483:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787602511.903499:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874436838988544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602511.903547:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602511.903641:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874436838988544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602511.903650:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787602511.905807:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944946fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838988544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787602512.349305:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787602512.467354:0:12518:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602512.467364:0:12518:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787602512.467422:0:12518:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 3 00000040:00080000:3.0:1787602512.467431:0:12518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787602512.602680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602512.602790:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821171712 00000100:00100000:2.0:1787602512.602804:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821171712 00000100:00100000:2.0:1787602512.602916:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 187 00000100:00100000:2.0:1787602512.602929:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:11529:x1874436821171712:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:2.0:1787602512.602965:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602512.602993:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af474f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350019 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787602512.605788:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602512.609334:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.609365:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.609380:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602512.609395:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787602512.609645:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af474f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350019 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.609669:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350019 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.609679:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602512.609682:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787602512.609686:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477600, rc 0) 00000100:00100000:2.0:1787602512.609788:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:11529:x1874436821171712:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 6860us (7124us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787602512.609799:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 187 00000100:00100000:3.0:1787602512.613388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602512.613521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821171840 00000100:00100000:2.0:1787602512.613541:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821171840 00000100:00100000:2.0:1787602512.613605:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 188 00000100:00100000:2.0:1787602512.613617:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:11529:x1874436821171840:12345-192.168.206.25@tcp:34:lfs.0 00010000:00010000:2.0:1787602512.613718:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af4750c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.613739:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af4750c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.613753:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af4750c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.613771:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47513 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.613779:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.613784:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614148:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614157:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614165:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602512.614215:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614241:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af4750c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614248:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af4750c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614256:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af4750c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614263:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602512.614268:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af4750c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614276:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af4750c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614291:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602512.614294:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602512.614300:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af4750c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614307:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af4750c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614320:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614326:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47513 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614332:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614345:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602512.614348:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614354:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47513 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614362:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48947900) 00010000:00010000:2.0:1787602512.614365:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602512.614367:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47513 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614373:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47513 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614388:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614395:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614400:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614420:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602512.614423:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614429:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614448:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48947a00) 00010000:00010000:2.0:1787602512.614451:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602512.614454:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.614459:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af4751a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602512.614552:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:11529:x1874436821171840:12345-192.168.206.25@tcp:34:lfs.0 Request processed in 935us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602512.614563:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 188 00000100:00100000:3.0:1787602512.693089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602512.696288:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821172096 00000100:00100000:1.0:1787602512.696305:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821172096 00000100:00100000:1.0:1787602512.696388:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 189 00000100:00100000:1.0:1787602512.696400:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:11532:x1874436821172096:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602512.696437:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602512.696464:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47521 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350020 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.696585:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47528 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.696603:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47528 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.696615:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47528 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.696630:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4752f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.696636:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4752f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.696642:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4752f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697055:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697066:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697074:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602512.697085:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787602512.697195:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47528 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697203:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47528 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697217:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47528 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697223:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602512.697228:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47528 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697236:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47528 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697251:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:1.0:1787602512.697255:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602512.697260:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47528 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697267:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47528 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697279:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4752f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697285:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4752f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697291:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4752f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697296:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ce00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602512.697299:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4752f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697316:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4752f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697325:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a43b20200) 00010000:00010000:1.0:1787602512.697327:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602512.697331:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4752f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697337:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af4752f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697384:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af47521 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350020 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697400:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350020 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.697417:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:1.0:1787602512.697419:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602512.697421:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c200, rc 0) 00000100:00100000:1.0:1787602512.697508:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+26:11532:x1874436821172096:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1109us (4431us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787602512.697516:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 189 00000100:00100000:0.0:1787602512.700902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602512.702795:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821172224 00000100:00100000:2.0:1787602512.702814:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821172224 00000100:00100000:2.0:1787602512.702894:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 190 00000100:00100000:2.0:1787602512.702905:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+26:11532:x1874436821172224:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:2.0:1787602512.702990:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47544 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.703009:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.703021:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.703083:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.703092:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47544 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.703114:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.703120:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602512.703125:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.703133:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47544 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.703148:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:2.0:1787602512.703152:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602512.703157:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47544 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.703164:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47544 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602512.703257:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+26:11532:x1874436821172224:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 352us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602512.703265:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 190 00000100:00100000:3.0:1787602512.705736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602512.705801:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821172480 00000100:00100000:1.0:1787602512.705813:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821172480 00000100:00100000:1.0:1787602512.705892:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00100000:1.0:1787602512.705905:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+26:11532:x1874436821172480:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:1.0:1787602512.706214:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:11532:x1874436821172480:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 310us (487us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787602512.706223:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00100000:0.0:1787602512.739254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602512.739399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821172736 00000100:00100000:1.0:1787602512.739422:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821172736 00000100:00100000:1.0:1787602512.739498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 191 00000100:00100000:1.0:1787602512.739511:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:11058:x1874436821172736:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602512.739547:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602512.739575:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4754b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350027 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.739703:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.739721:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350020 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.739732:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.739776:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350020 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.739791:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350020 expref: 28 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602512.739807:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838988672:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602512.739954:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a57d6c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602512.747303:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838988672:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602512.747341:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602512.752292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602512.752492:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821172864 00000100:00100000:1.0:1787602512.752505:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821172864 00010000:00010000:1.0:1787602512.752560:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350020 expref: 29 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602512.752610:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 75 00000100:00100000:1.0:1787602512.752622:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:2361:x1874436821172864:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602512.752639:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602512.752648:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350020 expref: 29 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.752664:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350020 expref: 29 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.752690:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47536 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350020 expref: 29 pid: 5834 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.752711:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:1.0:1787602512.752716:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.752728:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.752759:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.752797:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602512.752935:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.752946:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602512.752978:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:1.0:1787602512.752982:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+28:2361:x1874436821172864:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 361us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602512.752992:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 75 00010000:00010000:3.0:1787602512.753208:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4754b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350027 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.753226:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350027 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.753234:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:3.0:1787602512.753237:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602512.753239:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011ce00, rc 0) 00000100:00100000:3.0:1787602512.753286:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+28:11058:x1874436821172736:12345-192.168.206.25@tcp:101:bash.0 Request processed in 13778us (14046us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787602512.753295:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 191 00000100:00100000:0.0:1787602512.760949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602512.761014:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821173120 00000100:00100000:3.0:1787602512.761028:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821173120 00000100:00100000:3.0:1787602512.761137:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 192 00000100:00100000:3.0:1787602512.761151:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+28:11058:x1874436821173120:12345-192.168.206.25@tcp:36:bash.0 00010000:00010000:3.0:1787602512.761536:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.761708:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.761742:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602512.761810:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787602512.761840:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d8a52c1 reply state 00000000ba720e1d transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602512.761850:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787602512.761899:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787602512.762024:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:11058:x1874436821173120:12345-192.168.206.25@tcp:36:bash.0 Request processed in 875us (1090us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787602512.762032:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 192 00000020:00080000:3.0:1787602512.762078:0:9459:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787602512.766791:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.766817:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.766826:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.766833:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602512.766839:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.766848:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.766871:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:1.0:1787602512.766875:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602512.766880:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.766903:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af47560 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602512.768597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602512.768710:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821173248 00000100:00100000:3.0:1787602512.768723:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821173248 00000100:00100000:3.0:1787602512.768802:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 193 00000100:00100000:3.0:1787602512.768815:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+31:11058:x1874436821173248:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:3.0:1787602512.768843:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602512.768867:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47567 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235002e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.768941:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47567 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235002e expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.768958:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47567 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235002e expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.768982:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:3.0:1787602512.768997:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602512.769003:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70200, rc 0) 00000100:00100000:3.0:1787602512.769111:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:11058:x1874436821173248:12345-192.168.206.25@tcp:101:bash.0 Request processed in 297us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602512.769119:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 193 00000100:00100000:2.0:1787602512.772985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602512.773738:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821173376 00000100:00100000:1.0:1787602512.773814:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821173376 00000100:00100000:1.0:1787602512.773907:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 58 00000100:00080000:3.0:1787602512.773931:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602512.773982:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:11058:x1874436821173376:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602512.774009:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602512.774110:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af4756e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350035 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787602512.774149:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8ca64c, atime: 0x6a8ca64a, ctime: 0x6a8ca64c, blocks: 0xb 00010000:00010000:1.0:1787602512.774182:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1787602512.774189:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602512.774199:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af4756e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350035 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.774219:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af4756e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350035 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.774236:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c200, rc 0) 00000100:00100000:1.0:1787602512.774349:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:11058:x1874436821173376:12345-192.168.206.25@tcp:101:bash.0 Request processed in 431us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602512.774369:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 58 00000100:00100000:0.0:1787602512.778161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602512.778280:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821173504 00000100:00100000:2.0:1787602512.778295:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821173504 00002000:00010000:2.0:1787602512.778350:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787602512.778365:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944946feca80 with x1874436821173504 ext(0->18446744073709551615) 00002000:00010000:2.0:1787602512.778382:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944946feca80. 00000100:00100000:2.0:1787602512.778432:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:2.0:1787602512.778445:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946feca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2362:x1874436821173504:12345-192.168.206.25@tcp:10:bash.0 00002000:00010000:2.0:1787602512.778814:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787602512.778818:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787602508 -> 1787602511 00002000:00010000:2.0:1787602512.778821:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787602506 -> 1787602506 00002000:00010000:2.0:1787602512.778823:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787602508 -> 1787602511 00002000:00010000:2.0:1787602512.778826:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787602512.778907:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946feca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2362:x1874436821173504:12345-192.168.206.25@tcp:10:bash.0 Request processed in 464us (761us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787602512.778917:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 5 00002000:00010000:2.0:1787602512.778921:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787602512.778924:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944946feca80 with x1874436821173504 ext(0->18446744073709551615) 00002000:00010000:2.0:1787602512.778929:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944946feca80. 00000100:00100000:0.0:1787602512.859968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602512.860378:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821173632 00000100:00100000:2.0:1787602512.860392:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821173632 00000100:00100000:2.0:1787602512.861005:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 194 00000100:00100000:2.0:1787602512.861017:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:11546:x1874436821173632:12345-192.168.206.25@tcp:34:lfs.0 00010000:00010000:2.0:1787602512.861147:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47575 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861169:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47575 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861182:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47575 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861198:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af4757c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861205:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af4757c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861242:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af4757c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861612:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861622:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861629:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602512.861683:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861695:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47575 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861701:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47575 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861709:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47575 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861715:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602512.861720:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47575 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861727:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47575 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861741:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602512.861763:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602512.861769:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47575 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861775:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47575 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861800:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af4757c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861808:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af4757c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861814:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af4757c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861819:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602512.861822:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af4757c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861828:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af4757c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861837:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48947a00) 00010000:00010000:2.0:1787602512.861840:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602512.861843:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af4757c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861849:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af4757c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861865:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861877:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861883:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861888:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602512.861891:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861897:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861906:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:2.0:1787602512.861908:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602512.861910:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.861916:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af47583 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602512.862016:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:11546:x1874436821173632:12345-192.168.206.25@tcp:34:lfs.0 Request processed in 999us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602512.862026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 194 00000100:00100000:3.0:1787602512.916869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602512.917169:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821173888 00000100:00100000:2.0:1787602512.917183:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821173888 00000100:00100000:2.0:1787602512.917266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 195 00000100:00100000:2.0:1787602512.917279:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:11549:x1874436821173888:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:2.0:1787602512.917305:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602512.917350:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4758a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235003c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.917461:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47591 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.917479:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.917495:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.917512:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.917519:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.917526:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.918348:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4759f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.918363:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4759f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.918373:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4759f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602512.918387:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787602512.918735:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.919339:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47591 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.919346:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47591 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.919352:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602512.919358:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47591 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.919366:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47591 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.919382:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602512.919385:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602512.919391:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47591 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.919398:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af47591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.920337:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.920350:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47598 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.920357:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.920363:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602512.920383:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.920390:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.920402:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48947a00) 00010000:00010000:2.0:1787602512.920519:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602512.920525:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47598 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.920531:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.921158:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4758a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235003c expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.921177:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4759f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235003c expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602512.921186:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:2.0:1787602512.921188:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787602512.921191:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476400, rc 0) 00000100:00100000:2.0:1787602512.921296:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:11549:x1874436821173888:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 4018us (4439us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787602512.921306:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 195 00000100:00100000:0.0:1787602512.932621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602512.932731:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821174016 00000100:00100000:3.0:1787602512.932745:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821174016 00000100:00100000:3.0:1787602512.932830:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 196 00000100:00100000:3.0:1787602512.932845:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:11549:x1874436821174016:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:3.0:1787602512.932933:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.933335:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350027 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.933349:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.933399:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350027 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.933429:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350027 expref: 34 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602512.933449:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e55dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838988800:192.168.206.25@tcp:104: 00000100:00100000:3.0:1787602512.933613:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a487f1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602512.950921:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e55dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838988800:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602512.950943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00010000:00010000:1.0:1787602512.950963:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602512.950995:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821174272 00000100:00100000:0.0:1787602512.951005:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821174272 00000100:00100000:0.0:1787602512.951093:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00100000:1.0:1787602512.951100:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1787602512.951109:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+35:5597:x1874436821174272:12345-192.168.206.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787602512.951114:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1787602512.951640:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+36:5597:x1874436821174272:12345-192.168.206.25@tcp:35:ldlm_bl.0 Request processed in 534us (698us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787602512.951649:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00100000:0.0:1787602512.955744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602512.956945:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821174400 00000100:00100000:3.0:1787602512.956972:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821174400 00010000:00010000:3.0:1787602512.957057:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350027 expref: 36 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602512.957101:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 76 00000100:00100000:3.0:1787602512.957113:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+36:2362:x1874436821174400:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602512.957132:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602512.957140:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350027 expref: 36 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.957156:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350027 expref: 36 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.957181:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47552 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350027 expref: 36 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.957202:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:3.0:1787602512.957208:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.957533:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.957545:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602512.957585:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602512.957664:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+35:2362:x1874436821174400:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 551us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602512.957691:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 76 00010000:00010000:1.0:1787602512.957708:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.957720:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.957872:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.957882:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.957894:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.957902:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602512.957908:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.957917:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.957930:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:1.0:1787602512.957934:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602512.957938:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602512.957945:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af475ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602512.960737:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:11549:x1874436821174016:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 27883us (28119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602512.960957:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 196 00000100:00100000:0.0:1787602512.965076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602512.965116:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821174656 00000100:00100000:0.0:1787602512.965128:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821174656 00000100:00100000:0.0:1787602512.965183:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 53 00000100:00100000:0.0:1787602512.965195:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+34:11549:x1874436821174656:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602512.968224:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+35:11549:x1874436821174656:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 3006us (3169us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787602512.970097:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 53 00000001:00080000:0.0:1787602513.012241:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:3.0:1787602513.045846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602513.045916:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821174912 00000100:00100000:1.0:1787602513.045930:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821174912 00000100:00100000:1.0:1787602513.046086:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 197 00000100:00100000:1.0:1787602513.046100:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+35:11560:x1874436821174912:12345-192.168.206.25@tcp:101:cat.0 00010000:00010000:1.0:1787602513.046131:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602513.046158:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af475b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.046267:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af475bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.046284:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af475bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.046297:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af475bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.046314:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af475c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.046322:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af475c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.046329:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af475c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.046902:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af475c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.046914:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af475c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.046929:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af475c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602513.046942:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787602513.047070:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af475bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047079:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af475bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047086:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af475bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047093:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602513.047099:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af475bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047106:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af475bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047121:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602513.047124:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602513.047130:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af475bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047137:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af475bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047150:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af475c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047157:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af475c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047171:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af475c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047175:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602513.047178:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af475c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047183:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af475c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047190:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a43b20d00) 00010000:00010000:2.0:1787602513.047192:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602513.047195:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af475c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047200:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c600/0x576b7af90af475c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047249:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af475b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350043 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047262:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af475c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350043 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.047269:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:2.0:1787602513.047271:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602513.047274:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41476800, rc 0) 00000100:00100000:2.0:1787602513.047455:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e55dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+37:11560:x1874436821174912:12345-192.168.206.25@tcp:101:cat.0 Request processed in 1357us (1621us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787602513.047473:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 197 00000100:00100000:2.0:1787602513.052768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.052850:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821175168 00000100:00100000:3.0:1787602513.052865:0:12533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821175168 00000100:00100000:3.0:1787602513.052937:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 54 00000100:00100000:3.0:1787602513.052949:0:12533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+37:11560:x1874436821175168:12345-192.168.206.25@tcp:35:cat.0 00000100:00100000:3.0:1787602513.053972:0:12533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+38:11560:x1874436821175168:12345-192.168.206.25@tcp:35:cat.0 Request processed in 1018us (1214us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787602513.053991:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 54 00000100:00100000:0.0:1787602513.076337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.076586:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821175424 00000100:00100000:2.0:1787602513.076599:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821175424 00000100:00100000:2.0:1787602513.076689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 198 00000100:00100000:2.0:1787602513.076702:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+38:11561:x1874436821175424:12345-192.168.206.25@tcp:36:rm.0 00010000:00010000:2.0:1787602513.076779:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787602513.076813:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af475c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350043 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.076854:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4759f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235003c expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.076868:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47567 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235002e expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.076881:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a43b20100) 00010000:00010000:2.0:1787602513.076894:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602513.076921:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af475d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.076938:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af475d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.076949:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af475d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.076966:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.076992:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.077000:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.083840:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af475e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.083874:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af475e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.083889:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af475e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602513.085657:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787602513.085673:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344191635342ns, next at 345191632385ns, rc = 0 00010000:00010000:0.0:1787602513.085765:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085786:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085799:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085809:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085816:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085823:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085867:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602513.085894:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af475e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085900:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af475e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085906:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af475e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085913:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602513.085918:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af475e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085926:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af475e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085941:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48ace500) 00010000:00010000:0.0:1787602513.085945:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787602513.085950:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af475e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085957:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af475e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085980:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af475d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085987:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af475d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.085993:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af475d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.086004:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602513.086007:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af475d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.086014:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af475d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.086024:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602513.086026:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602513.086030:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af475d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.086068:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af475d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602513.086082:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090f835bb reply state 00000000cafc4243 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602513.086092:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602513.086195:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+37:11561:x1874436821175424:12345-192.168.206.25@tcp:36:rm.0 Request processed in 9490us (9865us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787602513.086205:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 198 00010000:00010000:1.0:1787602513.086770:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602513.086782:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.086791:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602513.086796:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.086804:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.086818:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff944a48ace500) 00010000:00010000:1.0:1787602513.086821:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787602513.086825:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.086830:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af475ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.086851:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602513.086853:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602513.086855:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602513.101782:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.101807:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.101816:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.101833:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602513.101839:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.101847:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.101868:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48947a00) 00010000:00010000:3.0:1787602513.101872:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602513.101877:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.101906:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af475de lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602513.142622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.145185:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821175680 00000100:00100000:2.0:1787602513.145206:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821175680 00000100:00100000:3.0:1787602513.145469:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 199 00000100:00100000:3.0:1787602513.145483:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+36:11567:x1874436821175680:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:3.0:1787602513.145516:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602513.145542:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af475f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235004a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.145712:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af475fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.145730:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af475fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.145742:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af475fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.145758:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.145765:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.145772:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787602513.146980:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787602513.147482:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147502:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147530:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147578:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af475fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147585:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af475fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147592:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af475fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147599:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602513.147604:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af475fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147612:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af475fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147627:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602513.147630:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602513.147635:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af475fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147641:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af475fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602513.147656:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c746844f reply state 0000000011e16c27 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602513.147666:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787602513.147718:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af475f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235004a expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147735:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235004a expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.147743:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48ace900) 00010000:00010000:0.0:1787602513.147745:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602513.147748:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459e00, rc 0) 00000100:00100000:0.0:1787602513.147843:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+39:11567:x1874436821175680:12345-192.168.206.25@tcp:101:bash.0 Request processed in 2362us (5236us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787602513.147853:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 199 00010000:00010000:3.0:1787602513.152271:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602513.152289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00010000:00010000:3.0:1787602513.152316:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.152324:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.152330:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602513.152336:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.152344:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.152364:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a58b88e00) 00010000:00010000:3.0:1787602513.152368:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602513.152373:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.152379:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47601 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602513.152519:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821175808 00000100:00100000:0.0:1787602513.152532:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821175808 00000100:00100000:0.0:1787602513.152605:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 59 00000100:00100000:0.0:1787602513.152618:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821175808:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:0.0:1787602513.152639:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602513.152661:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9b481ed/0x576b7af90af47616 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350051 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602513.152694:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602513.152716:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1787602513.152721:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602513.152732:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b481ed/0x576b7af90af47616 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350051 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.152752:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9b481ed/0x576b7af90af47616 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350051 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.152774:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459400, rc 0) 00000100:00100000:0.0:1787602513.152836:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2361:x1874436821175808:12345-192.168.206.25@tcp:101:bash.0 Request processed in 221us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602513.152844:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 59 00000100:00080000:3.0:1787602513.154278:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602513.155849:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602513.156200:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821175936 00000100:00100000:0.0:1787602513.156214:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821175936 00000100:00100000:0.0:1787602513.156310:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 60 00000100:00100000:0.0:1787602513.156325:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ea5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:11567:x1874436821175936:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:0.0:1787602513.156350:0:8475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602513.156373:0:8475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350058 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.156423:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9b481ed/0x576b7af90af47616 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350051 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.156434:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602513.156439:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602513.156445:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.156491:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9b481ed/0x576b7af90af47616 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350051 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.156511:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9b481ed/0x576b7af90af47616 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350051 expref: 7 pid: 6692 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602513.156553:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944946fec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8475:1874436838988928:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602513.156676:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602513.160300:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944946fec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8475:1874436838988928:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602513.160351:0:8475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 7 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.160375:0:8475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459200, rc 0) 00000100:00100000:2.0:1787602513.160460:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ea5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:11567:x1874436821175936:12345-192.168.206.25@tcp:101:bash.0 Request processed in 4139us (4623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602513.160471:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 60 00000100:00100000:1.0:1787602513.161933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.162105:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821176064 00000100:00100000:3.0:1787602513.162118:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821176064 00010000:00010000:3.0:1787602513.162173:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b481ed/0x576b7af90af47616 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350051 expref: 7 pid: 6692 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602513.162218:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 77 00000100:00100000:3.0:1787602513.162238:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821176064:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602513.162391:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602513.162429:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9b481ed/0x576b7af90af47616 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350051 expref: 7 pid: 6692 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.162445:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9b481ed/0x576b7af90af47616 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350051 expref: 7 pid: 6692 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.162472:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9b481ed/0x576b7af90af47616 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350051 expref: 7 pid: 6692 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.162490:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602513.162495:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602513.162505:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 6 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.162517:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 6 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.162565:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 6 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602513.162582:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a60404a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5819:1874436838989056:192.168.206.25@tcp:105: 00000100:00100000:3.0:1787602513.162792:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a585e8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602513.172445:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a60404a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5819:1874436838989056:192.168.206.25@tcp:105: 00010000:00010000:1.0:1787602513.172483:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602513.172484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602513.172562:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821176064:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 10325us (10638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602513.172576:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 77 00000100:00100000:0.0:1787602513.172749:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821176320 00000100:00100000:0.0:1787602513.172759:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821176320 00000100:00100000:0.0:1787602513.172899:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 55 00000100:00100000:0.0:1787602513.172911:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+38:11567:x1874436821176320:12345-192.168.206.25@tcp:35:bash.0 00000100:00100000:0.0:1787602513.173562:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+39:11567:x1874436821176320:12345-192.168.206.25@tcp:35:bash.0 Request processed in 649us (1078us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787602513.173572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 55 00000100:00100000:3.0:1787602513.305875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602513.306084:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821176448 00000100:00100000:1.0:1787602513.306099:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821176448 00000100:00100000:1.0:1787602513.306234:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 200 00000100:00100000:1.0:1787602513.306249:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+39:11583:x1874436821176448:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602513.306297:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602513.306325:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235005f expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.306452:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af4762b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.306470:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af4762b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.306485:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af4762b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602513.306577:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787602513.306581:0:9459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602513.306610:0:9459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af4762b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.306642:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235005f expref: 41 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.306663:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af4762b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235005f expref: 40 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.306672:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:1.0:1787602513.306675:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602513.306686:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c000, rc 0) 00000100:00100000:1.0:1787602513.306764:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:11583:x1874436821176448:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 518us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602513.306771:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 200 00000100:00100000:3.0:1787602513.309504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602513.310843:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821176704 00000100:00100000:0.0:1787602513.310860:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821176704 00000100:00100000:0.0:1787602513.310944:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 201 00000100:00100000:0.0:1787602513.310957:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+40:11583:x1874436821176704:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602513.310992:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602513.311020:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47632 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350066 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.311170:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af47639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.311186:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af47639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.311200:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af47639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602513.311236:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787602513.311434:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458600/0x576b7af90af47632 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350066 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.311455:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af47639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350066 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.311464:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48ace900) 00010000:00010000:0.0:1787602513.311467:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602513.311472:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458800, rc 0) 00000100:00100000:0.0:1787602513.311557:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+42:11583:x1874436821176704:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 601us (2067us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787602513.311566:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 201 00000100:00100000:2.0:1787602513.314878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.314979:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602513.315196:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821176960 00000100:00100000:1.0:1787602513.315217:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821176960 00000100:00100000:1.0:1787602513.315280:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 202 00000100:00100000:1.0:1787602513.315291:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+42:11583:x1874436821176960:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602513.315323:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602513.315350:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47647 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235006d expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.315483:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4764e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.315499:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4764e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.315511:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4764e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602513.315523:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787602513.315683:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011cc00/0x576b7af90af47647 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235006d expref: 45 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.315702:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4764e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235006d expref: 44 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.315713:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48ace900) 00010000:00010000:1.0:1787602513.315731:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787602513.315735:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d600, rc 0) 00000100:00100000:3.0:1787602513.315922:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821177088 00000100:00100000:3.0:1787602513.315929:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821177088 00000100:00100000:3.0:1787602513.316059:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00100000:3.0:1787602513.316068:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+45:2363:x1874436821177088:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602513.316080:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602513.316096:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458800/0x576b7af90af47639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350066 expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.316108:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48ace900) 00010000:00010000:3.0:1787602513.316112:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602513.316366:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+44:11583:x1874436821176960:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1075us (1500us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787602513.316374:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 202 00000100:00100000:3.0:1787602513.316453:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+43:2363:x1874436821177088:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 385us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602513.316460:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00100000:1.0:1787602513.320897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602513.321083:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821177216 00000100:00100000:0.0:1787602513.321096:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821177216 00000100:00100000:0.0:1787602513.321160:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 61 00000100:00100000:0.0:1787602513.321172:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+6:2362:x1874436821177216:12345-192.168.206.25@tcp:1:lfs.0 00010000:00010000:0.0:1787602513.321241:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.321267:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 6 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.321276:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602513.321281:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602513.321286:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.321347:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 6 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.321363:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 6 pid: 8475 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602513.321382:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944946fece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1874436838989184:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602513.321860:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787602513.324117:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944946fece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1874436838989184:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602513.324154:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602513.326222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.326513:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821177344 00000100:00100000:3.0:1787602513.326527:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821177344 00002000:00100000:3.0:1787602513.326588:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff944a6ebc4e00 x1874436821177344/t0(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:349/0 lens 504/0 e 0 to 0 dl 1787602524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602513.326601:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a6ebc4e00 with x1874436821177344 ext(0->8) 00010000:00010000:3.0:1787602513.326611:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 7 pid: 8475 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.326651:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 7 pid: 8475 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602513.326659:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff944a6ebc4e00 00000100:00100000:3.0:1787602513.326752:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:3.0:1787602513.326764:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821177344:12345-192.168.206.25@tcp:4:lfs.0 00000100:00100000:3.0:1787602513.327459:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2361:x1874436821177344:12345-192.168.206.25@tcp:4:lfs.0 Request processed in 692us (1244us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787602513.327469:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 3 00002000:00100000:3.0:1787602513.327478:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff944a6ebc4e00 x1874436821177344/t4294967308(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:349/0 lens 504/448 e 0 to 0 dl 1787602524 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602513.327487:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a6ebc4e00 with x1874436821177344 ext(0->8) 00010000:00010000:3.0:1787602513.327495:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 9 pid: 8475 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.327508:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 9 pid: 8475 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602513.327515:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff944a6ebc4e00 00000100:00100000:0.0:1787602513.331729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.331886:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821177472 00000100:00100000:3.0:1787602513.331899:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821177472 00010000:00010000:3.0:1787602513.331947:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 9 pid: 8475 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602513.332114:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 78 00000100:00100000:3.0:1787602513.332125:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2362:x1874436821177472:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602513.332144:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787602513.332168:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787602513.332171:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787602512 00002000:00010000:3.0:1787602513.332174:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787602512 00002000:00010000:3.0:1787602513.332176:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787602512 00010000:00010000:3.0:1787602513.332182:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 9 pid: 8475 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.332197:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 9 pid: 8475 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.332223:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4bfedf6/0x576b7af90af4761d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350058 expref: 9 pid: 8475 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.332382:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602513.332387:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602513.332395:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.332416:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.332463:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602513.332540:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2362:x1874436821177472:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 416us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602513.332548:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 78 00010000:00010000:1.0:1787602513.332680:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.332690:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.332717:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.332725:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.332733:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.332740:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602513.332744:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.332753:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.333547:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.333564:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8e97466/0x576b7af90af4765c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602513.333647:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821177216:12345-192.168.206.25@tcp:1:lfs.0 Request processed in 12476us (12765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602513.333656:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 61 00000100:00100000:0.0:1787602513.341187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.341860:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821177728 00000100:00100000:3.0:1787602513.341875:0:12533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821177728 00000100:00100000:2.0:1787602513.342320:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 56 00000100:00100000:2.0:1787602513.342338:0:12533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a5058b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+43:11583:x1874436821177728:12345-192.168.206.25@tcp:35:lfs.0 00000004:00010000:2.0:1787602513.342437:0:12533:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4764e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235006d expref: 43 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602513.342816:0:12533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787602513.342867:0:12533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787602513.343307:0:12533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787602513.343383:0:12533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.343413:0:12533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235004a expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.343424:0:12533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.343471:0:12533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235004a expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.343490:0:12533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235004a expref: 47 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602513.343507:0:12533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e94b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12533:1874436838989312:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602513.343699:0:12533:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48e72600 going to sleep for 11 seconds 00000100:00100000:3.0:1787602513.346942:0:12533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e94b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12533:1874436838989312:192.168.206.25@tcp:104: 00010000:00010000:3.0:1787602513.346980:0:12533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602513.347998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602513.348177:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821177856 00000100:00100000:1.0:1787602513.348188:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821177856 00010000:00010000:1.0:1787602513.348238:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235004a expref: 48 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602513.348294:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 79 00000100:00100000:1.0:1787602513.348306:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+48:2361:x1874436821177856:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602513.348326:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602513.348334:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235004a expref: 48 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.348350:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235004a expref: 48 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.348376:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47608 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235004a expref: 48 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.348434:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48ace900) 00010000:00010000:1.0:1787602513.348440:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.348451:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.348460:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.348495:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602513.348574:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+47:2361:x1874436821177856:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 269us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602513.348583:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 79 00010000:00010000:3.0:1787602513.348693:0:12533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.348703:0:12533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602513.349727:0:12533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787602513.350121:0:12533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787602513.350425:0:12533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e94b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12533:1874436838989440:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787602513.350579:0:12533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602513.350628:0:12533:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48e72840 going to sleep for 11 seconds 00000100:00100000:1.0:1787602513.350647:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838989440 00000100:00100000:1.0:1787602513.350658:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838989440 00000100:00100000:1.0:1787602513.350803:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787602513.350815:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12533:x1874436838989440:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1787602513.350916:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12533:x1874436838989440:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 102us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602513.350924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787602513.350996:0:12533:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787602513.351002:0:12533:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944a7c2d0e00, transno 4294967307 00000100:00100000:2.0:1787602513.351020:0:12533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e94b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12533:1874436838989440:0@lo:1000:mdt_rdpg00_002.0 00000100:00080000:3.0:1787602513.351582:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787602513.352870:0:12533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787602513.353174:0:12533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e94b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12533:1874436838989568:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787602513.353254:0:12533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602513.353441:0:12533:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48e72540 going to sleep for 11 seconds 00000100:00100000:0.0:1787602513.353495:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838989568 00000100:00100000:0.0:1787602513.353505:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838989568 00000100:00100000:0.0:1787602513.353571:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787602513.353582:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12533:x1874436838989568:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787602513.353971:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12533:x1874436838989568:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 379us (706us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787602513.353980:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787602513.354597:0:12533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e94b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12533:1874436838989568:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787602513.354690:0:12533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787602513.354865:0:12533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.354880:0:12533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.354889:0:12533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.354896:0:12533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602513.354902:0:12533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.354911:0:12533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.354934:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48ace900) 00010000:00010000:2.0:1787602513.354937:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787602513.354944:0:12533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.354951:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47663 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787602513.355596:0:12533:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787602513.355717:0:12533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787602513.355730:0:12533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344461692729ns, next at 345461689760ns, rc = 0 00000001:00080000:2.0:1787602513.355741:0:12533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787602513.355890:0:12533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48ace900) 00010000:00010000:2.0:1787602513.355895:0:12533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787602513.355904:0:12533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4764e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235006d expref: 51 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602513.356112:0:12533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a5058b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:11583:x1874436821177728:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 13779us (14938us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787602513.356122:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 56 00000020:00080000:2.0:1787602513.356130:0:12533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787602513.359297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.360894:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821177984 00000100:00100000:2.0:1787602513.360916:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821177984 00000100:00100000:2.0:1787602513.361135:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 203 00000100:00100000:2.0:1787602513.361151:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+50:11583:x1874436821177984:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:2.0:1787602513.361199:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602513.361232:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4766a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350074 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.361658:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4766a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350074 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.361678:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4766a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350074 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.361706:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602513.361710:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602513.361715:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477800, rc 0) 00000100:00100000:2.0:1787602513.361887:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:11583:x1874436821177984:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 739us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602513.361919:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 203 00000100:00100000:0.0:1787602513.365543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.365713:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821178240 00000100:00100000:3.0:1787602513.365725:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821178240 00000100:00100000:3.0:1787602513.365792:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 57 00000100:00100000:3.0:1787602513.365806:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+51:11583:x1874436821178240:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:3.0:1787602513.366208:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:11583:x1874436821178240:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 403us (677us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787602513.366218:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 57 00010000:00010000:2.0:1787602513.377016:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602513.461593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.461698:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821178368 00000100:00100000:2.0:1787602513.461711:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821178368 00000100:00100000:2.0:1787602513.461867:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 204 00000100:00100000:2.0:1787602513.461882:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:11593:x1874436821178368:12345-192.168.206.25@tcp:34:lfs.0 00010000:00010000:2.0:1787602513.461994:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47671 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462018:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47671 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462033:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47671 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462083:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47678 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462092:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462098:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462242:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462251:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462258:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602513.462333:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462349:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47671 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462356:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47671 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462364:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47671 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462371:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602513.462375:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47671 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462383:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47671 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462398:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602513.462411:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602513.462417:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47671 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462424:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af47671 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462440:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462445:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47678 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462458:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47678 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462463:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602513.462467:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47678 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462473:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47678 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462482:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48947c00) 00010000:00010000:2.0:1787602513.462485:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602513.462488:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47678 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462493:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af47678 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462509:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462516:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462522:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462529:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602513.462532:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462549:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462558:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602513.462560:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602513.462563:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.462569:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af4767f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602513.462666:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:11593:x1874436821178368:12345-192.168.206.25@tcp:34:lfs.0 Request processed in 787us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602513.462675:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 204 00000100:00100000:0.0:1787602513.505136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.505337:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821178624 00000100:00100000:3.0:1787602513.505464:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821178624 00000100:00100000:3.0:1787602513.505598:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 205 00000100:00100000:3.0:1787602513.505611:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+52:11596:x1874436821178624:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602513.505638:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602513.505673:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235007b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.505765:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4768d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.505783:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4768d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.505797:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4768d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.505812:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.505819:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.505826:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506128:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506138:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506146:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602513.506157:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787602513.506563:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4768d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506585:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4768d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506593:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4768d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506600:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602513.506605:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4768d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506614:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4768d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506628:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:3.0:1787602513.506632:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602513.506637:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4768d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506644:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af4768d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506660:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506667:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47694 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506673:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506678:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602513.506686:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506692:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506699:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a58b88e00) 00010000:00010000:3.0:1787602513.506702:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602513.506704:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47694 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506710:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af47694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506758:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235007b expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506772:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235007b expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.506779:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602513.506782:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602513.506784:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70800, rc 0) 00000100:00100000:3.0:1787602513.507447:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:11596:x1874436821178624:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1833us (2322us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787602513.507457:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 205 00000100:00100000:0.0:1787602513.513798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.514178:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821178752 00000100:00100000:2.0:1787602513.514193:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821178752 00000100:00100000:1.0:1787602513.514362:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 206 00000100:00100000:1.0:1787602513.514378:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:11596:x1874436821178752:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:1.0:1787602513.514489:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.514511:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.514543:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.514576:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.514584:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.514591:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.514598:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ce00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602513.514603:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.514611:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.514624:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602513.514627:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602513.514632:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.514638:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602513.514724:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:11596:x1874436821178752:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 350us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602513.514732:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 206 00000100:00100000:0.0:1787602513.518166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.518281:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821179008 00000100:00100000:2.0:1787602513.518294:0:12533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821179008 00000100:00100000:2.0:1787602513.518361:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 58 00000100:00100000:2.0:1787602513.518374:0:12533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+54:11596:x1874436821179008:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:2.0:1787602513.518697:0:12533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:11596:x1874436821179008:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 324us (543us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787602513.518705:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 58 00000100:00100000:0.0:1787602513.601134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.601276:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821179264 00000100:00100000:2.0:1787602513.601290:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821179264 00000100:00100000:2.0:1787602513.601377:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 207 00000100:00100000:2.0:1787602513.601391:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:11606:x1874436821179264:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:2.0:1787602513.601451:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602513.601455:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787602513.601490:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c000/0x576b7af90af4762b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235005f expref: 55 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.601514:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602513.601520:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602513.601765:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350082 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.601899:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.601915:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235007b expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.601925:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.601965:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235007b expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.601979:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235007b expref: 55 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602513.601995:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e94a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838989696:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602513.602223:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48e720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602513.607344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.607525:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e94a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874436838989696:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602513.607591:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602513.607937:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821179392 00000100:00100000:1.0:1787602513.607954:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821179392 00010000:00010000:1.0:1787602513.607998:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235007b expref: 56 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602513.608057:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 80 00000100:00100000:1.0:1787602513.608068:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:2362:x1874436821179392:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602513.608087:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602513.608095:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235007b expref: 56 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.608108:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235007b expref: 56 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.608132:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70800/0x576b7af90af4769b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235007b expref: 56 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.608151:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602513.608157:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.608167:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.608175:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.608200:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602513.608698:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.608709:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602513.608734:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787602513.608937:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350082 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.608957:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350082 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.608965:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602513.608968:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787602513.608971:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477400, rc 0) 00000100:00100000:0.0:1787602513.609023:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+56:11606:x1874436821179264:12345-192.168.206.25@tcp:101:bash.0 Request processed in 7634us (7904us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787602513.609032:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 207 00000100:00100000:1.0:1787602513.609511:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:2362:x1874436821179392:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 1439us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602513.609611:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 80 00000100:00100000:3.0:1787602513.612486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602513.613592:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821179648 00000100:00100000:1.0:1787602513.613612:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821179648 00000100:00100000:1.0:1787602513.613683:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 208 00000100:00100000:1.0:1787602513.613694:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+55:11606:x1874436821179648:12345-192.168.206.25@tcp:36:bash.0 00010000:00010000:1.0:1787602513.614212:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.614235:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.614249:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602513.614486:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787602513.614514:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae95966e reply state 000000009800ce5c transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602513.614524:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602513.615026:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11606:x1874436821179648:12345-192.168.206.25@tcp:36:bash.0 Request processed in 1329us (2550us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787602513.615054:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 208 00000020:00080000:1.0:1787602513.615061:0:9459:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602513.617672:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.617711:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.617719:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.617725:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ce00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602513.617731:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.617738:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.617759:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602513.617762:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602513.618302:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.618317:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af476c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602513.620266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602513.620671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821179776 00000100:00100000:0.0:1787602513.620685:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821179776 00000100:00100000:0.0:1787602513.620784:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 209 00000100:00100000:0.0:1787602513.620797:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11606:x1874436821179776:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:0.0:1787602513.620838:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602513.620867:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af476cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350089 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.620990:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.621026:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350082 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.621084:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.621135:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350082 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.621150:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350082 expref: 58 pid: 5833 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602513.621166:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a75615880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838989824:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602513.621268:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602513.628579:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a75615880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838989824:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602513.628620:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602513.630216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602513.631789:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821179904 00000100:00100000:0.0:1787602513.631810:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821179904 00010000:00010000:0.0:1787602513.631881:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350082 expref: 59 pid: 5833 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602513.631939:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 81 00000100:00100000:0.0:1787602513.631952:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:2361:x1874436821179904:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602513.631972:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602513.631998:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350082 expref: 59 pid: 5833 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.632013:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350082 expref: 59 pid: 5833 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.632111:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350082 expref: 59 pid: 5833 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.632134:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602513.632140:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.632151:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.632160:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602513.632195:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602513.632332:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:2361:x1874436821179904:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 382us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602513.632341:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 81 00010000:00010000:3.0:1787602513.632704:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.632714:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602513.632771:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787602513.632776:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602513.632813:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.632853:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af476cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350089 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.632870:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350089 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.632878:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602513.632881:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602513.632884:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459c00, rc 0) 00000100:00100000:3.0:1787602513.632922:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11606:x1874436821179776:12345-192.168.206.25@tcp:101:bash.0 Request processed in 12128us (12678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602513.632929:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 209 00000100:00100000:2.0:1787602513.638855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.638941:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821180160 00000100:00100000:3.0:1787602513.638954:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821180160 00000100:00100000:3.0:1787602513.639019:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 59 00000100:00100000:3.0:1787602513.639030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+57:11606:x1874436821180160:12345-192.168.206.25@tcp:35:bash.0 00000100:00100000:3.0:1787602513.639367:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11606:x1874436821180160:12345-192.168.206.25@tcp:35:bash.0 Request processed in 338us (528us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787602513.639375:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 59 00000100:00100000:2.0:1787602513.748332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.748842:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821180288 00000100:00100000:3.0:1787602513.748856:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821180288 00000100:00100000:3.0:1787602513.749007:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 210 00000100:00100000:3.0:1787602513.749020:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+58:11612:x1874436821180288:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602513.749103:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602513.749146:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af476da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350090 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.749231:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af476e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.749248:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af476e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.749274:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af476e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602513.749364:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787602513.749369:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602513.749397:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af476e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.749439:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af476da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350090 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.749458:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af476e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350090 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.749466:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:3.0:1787602513.749469:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602513.749473:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70c00, rc 0) 00000100:00100000:3.0:1787602513.749568:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11612:x1874436821180288:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 551us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602513.749575:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 210 00000100:00100000:1.0:1787602513.755797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.756015:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821180416 00000100:00100000:2.0:1787602513.756027:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821180416 00000100:00100000:2.0:1787602513.756123:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 211 00000100:00100000:2.0:1787602513.756135:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11612:x1874436821180416:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:2.0:1787602513.756160:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602513.756187:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af476e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350097 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.756668:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af476ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.756688:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af476ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.756702:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af476ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.756720:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.756727:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.756734:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.757642:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.757659:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.757669:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602513.757721:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787602513.757727:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602513.757753:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.757767:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.757778:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af476ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.757785:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af476ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.757794:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af476ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.757800:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602513.757805:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af476ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.757814:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af476ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758611:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602513.758616:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602513.758623:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af476ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758630:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476800/0x576b7af90af476ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758650:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758657:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758665:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758672:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602513.758676:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758683:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758691:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48947c00) 00010000:00010000:2.0:1787602513.758694:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602513.758697:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758704:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476400/0x576b7af90af476f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758773:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477e00/0x576b7af90af476e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350097 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758791:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350097 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.758799:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602513.758801:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602513.758804:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41477400, rc 0) 00000100:00100000:2.0:1787602513.759198:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:11612:x1874436821180416:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 3063us (3413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602513.759209:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 211 00000100:00100000:2.0:1787602513.763799:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602513.763928:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821180672 00000100:00100000:1.0:1787602513.763940:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821180672 00000100:00100000:3.0:1787602513.765423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602513.765541:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821180800 00000100:00100000:2.0:1787602513.765551:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821180800 00000100:00100000:2.0:1787602513.765626:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:2.0:1787602513.765638:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:2361:x1874436821180800:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602513.765662:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602513.765697:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477400/0x576b7af90af476fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350097 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.765722:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602513.765729:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602513.765799:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:2361:x1874436821180800:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 162us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602513.765807:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:1.0:1787602513.767708:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 212 00000100:00100000:1.0:1787602513.767734:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11612:x1874436821180672:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602513.767788:0:9459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602513.767815:0:9459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47704 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235009e expref: -99 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.767968:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.767987:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350089 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.767998:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.768075:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350089 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602513.768091:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350089 expref: 60 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602513.768107:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838989952:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602513.768224:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a57d6c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602513.773582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.774104:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821180928 00000100:00100000:3.0:1787602513.774117:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821180928 00010000:00010000:3.0:1787602513.774171:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350089 expref: 61 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602513.774224:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 82 00000100:00100000:3.0:1787602513.774237:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:2362:x1874436821180928:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602513.774266:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602513.774276:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350089 expref: 61 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.774292:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350089 expref: 61 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.774320:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602513.774326:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.774336:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.774345:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.774381:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602513.774458:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:2362:x1874436821180928:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 222us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602513.774467:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 82 00010000:00010000:2.0:1787602513.777198:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af476d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350089 expref: 60 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602513.777240:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838989952:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602513.777382:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.777396:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.777469:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602513.777500:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787602513.777787:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c400/0x576b7af90af47704 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235009e expref: 61 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.777807:0:9459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235009e expref: 60 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602513.777820:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602513.777824:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787602513.777828:0:9459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d800, rc 0) 00000100:00100000:2.0:1787602513.778081:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:11612:x1874436821180672:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 10357us (14294us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787602513.778092:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 212 00000100:00100000:1.0:1787602513.785431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.785589:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821181184 00000100:00100000:3.0:1787602513.785619:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821181184 00000100:00100000:3.0:1787602513.785756:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:3.0:1787602513.785770:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41327b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:11612:x1874436821181184:12345-192.168.206.25@tcp:103:lfs.0 00010000:00010000:3.0:1787602513.785790:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602513.785822:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477800/0x576b7af90af4766a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350074 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.785847:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602513.785853:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602513.786950:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41327b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11612:x1874436821181184:12345-192.168.206.25@tcp:103:lfs.0 Request processed in 1172us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602513.786966:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:0.0:1787602513.790657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.790741:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821181312 00000100:00100000:3.0:1787602513.790753:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821181312 00000100:00100000:3.0:1787602513.790824:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 213 00000100:00100000:3.0:1787602513.790837:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11612:x1874436821181312:12345-192.168.206.25@tcp:58:lfs.0 00010000:00010000:3.0:1787602513.790968:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.790988:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.791002:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602513.791602:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787602513.791746:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11612:x1874436821181312:12345-192.168.206.25@tcp:58:lfs.0 Request processed in 908us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602513.791756:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 213 00000100:00100000:0.0:1787602513.794641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602513.794826:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821181440 00000100:00100000:3.0:1787602513.794851:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821181440 00000100:00100000:3.0:1787602513.795016:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 214 00000100:00100000:3.0:1787602513.795031:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+59:11612:x1874436821181440:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602513.795116:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602513.795143:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500a5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.795218:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.795230:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47720 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500a5 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.795256:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.795271:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47720 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500a5 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.795288:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602513.795291:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602513.795295:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47720 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500a5 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602513.795303:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71000, rc 0) 00000100:00100000:3.0:1787602513.795371:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:11612:x1874436821181440:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 344us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602513.795378:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 214 00000040:00080000:0.0:1787602514.013396:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787602514.013434:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787602514.013638:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787602514.013647:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787602514.013807:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a75615500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838990080:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787602514.014135:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602514.025320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.027988:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821181568 00000100:00100000:3.0:1787602514.028008:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821181568 00000100:00080000:0.0:1787602514.028130:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602514.028172:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 215 00000100:00100000:3.0:1787602514.028204:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11613:x1874436821181568:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787602514.028255:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787602514.028392:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11613:x1874436821181568:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 191us (3094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.028412:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 215 00000100:00100000:2.0:1787602514.031369:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a75615500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838990080:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787602514.036020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.037336:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821181696 00000100:00100000:2.0:1787602514.037709:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821181696 00000100:00100000:2.0:1787602514.037835:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 216 00000100:00100000:2.0:1787602514.037847:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:11613:x1874436821181696:12345-192.168.206.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787602514.037949:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47727 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.037971:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47727 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.037988:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47727 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038006:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4772e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038014:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4772e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038021:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4772e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038089:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038100:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038107:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602514.038155:0:9459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787602514.038160:0:9459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602514.038188:0:9459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038203:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47727 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038209:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47727 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038217:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47727 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038224:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40030e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602514.038229:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47727 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038237:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47727 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038266:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:2.0:1787602514.038270:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602514.038276:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47727 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038283:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47727 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038298:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4772e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038304:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4772e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038310:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4772e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038323:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40030a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602514.038326:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4772e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038331:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4772e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038339:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff944a48947c00) 00010000:00010000:2.0:1787602514.038341:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602514.038344:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4772e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038349:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4772e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038379:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038385:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038391:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038396:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40030c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602514.038409:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038415:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038433:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602514.038435:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602514.038438:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.038453:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47735 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602514.038558:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:11613:x1874436821181696:12345-192.168.206.25@tcp:34:lhsmtool_posix.0 Request processed in 712us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602514.038568:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 216 00000100:00100000:0.0:1787602514.048886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.053677:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821181952 00000100:00100000:3.0:1787602514.053701:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821181952 00000100:00100000:3.0:1787602514.053800:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 217 00000100:00100000:3.0:1787602514.053814:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+60:11613:x1874436821181952:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602514.053843:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602514.053871:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4773c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.054004:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.054023:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.054852:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602514.054878:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787602514.055025:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.055192:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47743 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.055203:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.055229:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602514.055235:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.055243:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47743 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.055272:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602514.055276:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787602514.055282:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47743 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.055288:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.060971:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4773c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ac expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.061000:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:0.0:1787602514.061004:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602514.061010:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71e00/0x576b7af90af4773c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ac expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.061033:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71e00, rc 0) 00000100:00100000:0.0:1787602514.061291:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11613:x1874436821181952:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 7477us (12417us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1787602514.061311:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 217 00000100:00100000:2.0:1787602514.074192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.074346:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821182080 00000100:00100000:3.0:1787602514.074369:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821182080 00000100:00100000:3.0:1787602514.074457:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 218 00000100:00100000:3.0:1787602514.074470:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11613:x1874436821182080:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787602514.074786:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787602514.074914:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11613:x1874436821182080:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 446us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.074922:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 218 00000100:00100000:1.0:1787602514.085330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602514.085834:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821182336 00000100:00100000:0.0:1787602514.085848:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821182336 00000100:00100000:0.0:1787602514.085930:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 219 00000100:00100000:0.0:1787602514.085942:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11613:x1874436821182336:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602514.085969:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602514.085973:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787602514.086008:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70c00/0x576b7af90af476e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350090 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.086086:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602514.086092:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602514.086110:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af47751 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500b3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602514.088676:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1787602514.088973:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47758 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.089020:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.089104:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47758 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.089195:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459000/0x576b7af90af47751 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500b3 expref: 63 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.089219:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47758 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500b3 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.089229:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a43b20e00) 00010000:00010000:1.0:1787602514.089232:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602514.089236:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d600, rc 0) 00000100:00100000:1.0:1787602514.089327:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+62:11613:x1874436821182336:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 3386us (4010us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787602514.089338:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 219 00000100:00100000:1.0:1787602514.096500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.097417:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821182592 00000100:00100000:3.0:1787602514.097433:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821182592 00000100:00100000:3.0:1787602514.097521:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 220 00000100:00100000:3.0:1787602514.097537:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+62:11613:x1874436821182592:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787602514.097628:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602514.097681:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47758 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500b3 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097702:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a43b20e00) 00010000:00010000:3.0:1787602514.097715:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602514.097743:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47766 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097757:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47766 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097767:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47766 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097782:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af4776d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x946db870 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097790:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af4776d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x946db870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097796:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af4776d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x946db870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097895:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47766 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097901:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47766 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097907:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47766 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097913:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602514.097925:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47766 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097933:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47766 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097941:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:3.0:1787602514.097944:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602514.097948:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47766 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097953:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af47766 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097974:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af4776d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x946db870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.097980:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af4776d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x946db870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.098419:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af4776d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x946db870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.098427:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602514.098431:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af4776d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x946db870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.098438:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af4776d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x946db870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.098501:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x946db870 (ffff944a58b88e00) 00010000:00010000:3.0:1787602514.098503:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602514.098515:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af4776d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x946db870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.098522:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af4776d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x946db870 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602514.099577:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11613:x1874436821182592:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 2034us (3079us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602514.099590:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 220 00000100:00100000:0.0:1787602514.102492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.102663:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821182720 00000100:00100000:2.0:1787602514.102678:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821182720 00000100:00100000:2.0:1787602514.102752:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 221 00000100:00100000:2.0:1787602514.102764:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+61:11613:x1874436821182720:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602514.102793:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602514.102825:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47774 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500ba expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.102874:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.102890:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.102904:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.103092:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47774 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ba expref: 63 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.103115:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ba expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.103125:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48947c00) 00010000:00010000:2.0:1787602514.103129:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787602514.103133:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a40030a00, rc 0) 00000100:00100000:2.0:1787602514.103208:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+62:11613:x1874436821182720:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 445us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602514.103217:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 221 00000100:00100000:1.0:1787602514.107736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.108767:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821182976 00000100:00100000:2.0:1787602514.108785:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821182976 00000100:00100000:2.0:1787602514.108872:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 222 00000100:00100000:2.0:1787602514.108885:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+62:11613:x1874436821182976:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787602514.109003:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.109024:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.109059:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787602514.109607:0:9459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787602514.109621:0:9459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345215583279ns, next at 346215580256ns, rc = 0 00000004:00010000:2.0:1787602514.109757:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9883d7e reply state 0000000091b2f5e3 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602514.109768:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602514.109896:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+64:11613:x1874436821182976:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 1012us (2174us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787602514.109905:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 222 00010000:00010000:3.0:1787602514.122164:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.122191:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.122200:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.122206:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40030e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602514.122213:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.122220:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.122243:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48947c00) 00010000:00010000:3.0:1787602514.122246:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787602514.122252:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.122258:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47782 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602514.131012:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.131210:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821183104 00000100:00100000:2.0:1787602514.131224:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821183104 00000100:00100000:2.0:1787602514.131296:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 223 00000100:00100000:2.0:1787602514.131309:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+63:11613:x1874436821183104:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602514.131340:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602514.131374:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47789 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.131467:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47789 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c1 expref: 64 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.131485:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47789 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c1 expref: 64 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.131507:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48947c00) 00010000:00010000:2.0:1787602514.131511:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602514.131526:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a40030c00, rc 0) 00000100:00100000:2.0:1787602514.131599:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+64:11613:x1874436821183104:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 292us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602514.131608:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 223 00000100:00100000:0.0:1787602514.140002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602514.140322:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821183232 00000100:00100000:1.0:1787602514.140336:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821183232 00000100:00100000:1.0:1787602514.140442:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 62 00000100:00100000:1.0:1787602514.140455:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2362:x1874436821183232:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787602514.141133:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:2362:x1874436821183232:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 Request processed in 677us (1151us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787602514.141164:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 62 00000100:00080000:0.0:1787602514.141248:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602514.156832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.157367:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821183488 00000100:00100000:3.0:1787602514.157383:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821183488 00000100:00100000:3.0:1787602514.158154:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 60 00000100:00100000:3.0:1787602514.160808:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+64:11613:x1874436821183488:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787602514.162599:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+65:11613:x1874436821183488:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 1814us (5770us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787602514.162626:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 60 00000100:00100000:3.0:1787602514.165387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.165696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821183744 00000100:00100000:2.0:1787602514.165726:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821183744 00000100:00100000:2.0:1787602514.165801:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 224 00000100:00100000:2.0:1787602514.165814:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+65:11613:x1874436821183744:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787602514.165962:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+65:11613:x1874436821183744:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 150us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602514.165971:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 224 00000100:00100000:1.0:1787602514.173267:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.173449:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821183872 00000100:00100000:2.0:1787602514.173464:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821183872 00000100:00100000:2.0:1787602514.173537:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 225 00000100:00100000:2.0:1787602514.173549:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+65:11613:x1874436821183872:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602514.173575:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602514.173601:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af47790 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500c8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.173727:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47797 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.173744:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.173757:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602514.173802:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602514.173822:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.173850:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af47790 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c8 expref: 67 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.173884:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c8 expref: 66 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.173894:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48947c00) 00010000:00010000:2.0:1787602514.173897:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787602514.173900:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a40030e00, rc 0) 00000100:00100000:2.0:1787602514.173967:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+66:11613:x1874436821183872:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 421us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602514.173975:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 225 00000100:00100000:0.0:1787602514.179669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.179830:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821184000 00000100:00100000:3.0:1787602514.179842:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821184000 00000100:00100000:3.0:1787602514.179922:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 63 00000100:00100000:3.0:1787602514.179935:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+10:2364:x1874436821184000:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602514.179959:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602514.179995:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af4779e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500cf expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602514.180030:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ca651, blocks: 0x1 00010000:00010000:3.0:1787602514.180090:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1787602514.180097:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602514.180108:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af4779e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500cf expref: 11 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.180132:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af4779e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500cf expref: 11 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.180150:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70400, rc 0) 00000100:00100000:3.0:1787602514.180229:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+11:2364:x1874436821184000:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 297us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.180267:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 63 00000100:00100000:3.0:1787602514.183473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602514.183777:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821184256 00000100:00100000:1.0:1787602514.183790:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821184256 00000100:00100000:1.0:1787602514.183865:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 226 00000100:00100000:1.0:1787602514.183877:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+66:11613:x1874436821184256:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787602514.184019:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+66:11613:x1874436821184256:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 143us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602514.184027:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 226 00000100:00100000:0.0:1787602514.189030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602514.189172:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821184384 00000100:00100000:1.0:1787602514.189186:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821184384 00000100:00100000:1.0:1787602514.189255:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 64 00000100:00100000:1.0:1787602514.189277:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+11:11613:x1874436821184384:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602514.189301:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602514.189326:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500d6 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.189405:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af4779e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500cf expref: 12 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.189416:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602514.189420:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602514.189426:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.189481:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af4779e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500cf expref: 12 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.189499:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af4779e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500cf expref: 12 pid: 6693 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602514.189516:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a41327480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1874436838990208:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602514.189915:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a57d6c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602514.202092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.202190:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821184512 00000100:00100000:3.0:1787602514.202202:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821184512 00010000:00010000:3.0:1787602514.202254:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af4779e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500cf expref: 13 pid: 6693 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602514.202301:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 83 00000100:00100000:3.0:1787602514.202313:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:2362:x1874436821184512:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602514.202331:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602514.202359:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af4779e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500cf expref: 13 pid: 6693 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.202375:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af4779e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500cf expref: 13 pid: 6693 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.202416:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602514.202422:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602514.202432:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 13 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.202443:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 13 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.202490:0:8454:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 13 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602514.202526:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8454:1874436838990336:192.168.206.25@tcp:105: 00000100:00100000:3.0:1787602514.202624:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a62085480 going to sleep for 11 seconds 00010000:00010000:1.0:1787602514.207585:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df80ca90/0x576b7af90af4779e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500cf expref: 13 pid: 6693 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602514.207762:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a41327480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1874436838990208:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602514.207804:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.207822:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c600, rc 0) 00000100:00100000:1.0:1787602514.207910:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+12:11613:x1874436821184384:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 18634us (18892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602514.207921:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 64 00000100:00100000:1.0:1787602514.209994:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8454:1874436838990336:192.168.206.25@tcp:105: 00010000:00010000:1.0:1787602514.210028:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602514.210134:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+11:2362:x1874436821184512:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 7821us (8096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602514.210167:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 83 00000100:00100000:3.0:1787602514.216786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602514.216914:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821184640 00000100:00100000:0.0:1787602514.216927:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821184640 00002000:00100000:0.0:1787602514.217013:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff944a4d3dbb80 x1874436821184640/t0(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:350/0 lens 504/0 e 0 to 0 dl 1787602525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602514.217026:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a4d3dbb80 with x1874436821184640 ext(0->12) 00002000:00010000:0.0:1787602514.217033:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a4d3dbb80 00000100:00100000:0.0:1787602514.217115:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:0.0:1787602514.217128:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+11:2361:x1874436821184640:12345-192.168.206.25@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787602514.217864:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:2361:x1874436821184640:12345-192.168.206.25@tcp:4:lhsmtool_posix.0 Request processed in 731us (1087us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787602514.217880:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 6 00002000:00100000:0.0:1787602514.217890:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff944a4d3dbb80 x1874436821184640/t4294967320(0) o4->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:350/0 lens 504/448 e 0 to 0 dl 1787602525 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602514.217900:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a4d3dbb80 with x1874436821184640 ext(0->12) 00002000:00010000:0.0:1787602514.217905:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a4d3dbb80 00000100:00100000:0.0:1787602514.221320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.221440:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821184768 00000100:00100000:2.0:1787602514.221454:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821184768 00000100:00100000:2.0:1787602514.221526:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 227 00000100:00100000:2.0:1787602514.221538:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+66:11613:x1874436821184768:12345-192.168.206.25@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787602514.270453:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+66:11613:x1874436821184768:12345-192.168.206.25@tcp:44:lhsmtool_posix.0 Request processed in 48898us (49128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602514.270469:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 227 00000001:00080000:3.0:1787602514.270614:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1787602514.270644:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787602514.270666:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1787602514.270700:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1787602514.270711:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787602514.270729:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff944a48e72840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787602514.270734:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6e9da900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff944a48e723c0 00000020:00080000:3.0:1787602514.270736:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6e9da200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff944a6eff2000 00000020:00080000:3.0:1787602514.270760:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff944a4d262f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787602514.270763:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6e9dac00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff944a4d3293c0 00000020:00080000:3.0:1787602514.270766:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a6e9daf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9449462c4800 00000020:00080000:3.0:1787602514.270813:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787602514.271217:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787602514.271432:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838990464:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787602514.271511:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602514.271605:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838990464 00000100:00100000:3.0:1787602514.271614:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838990464 00000100:00100000:3.0:1787602514.271668:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787602514.271678:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874436838990464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787602514.271712:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1787602514.271767:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8ca650, atime: 0x6a8ca650, ctime: 0x6a8ca650, blocks: 0x1 00010000:00010000:3.0:1787602514.271776:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b76aa85/0x576b7af90af477ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.271794:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1787602514.271800:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602514.271808:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b76aa85/0x576b7af90af477ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.271826:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b76aa85/0x576b7af90af477ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.271838:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b76aa85/0x576b7af90af477ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.271847:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b76aa85/0x576b7af90af477ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.271867:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787602514.272716:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a41327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838990592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787602514.272769:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602514.272871:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838990592 00000100:00100000:1.0:1787602514.272879:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838990592 00000100:00100000:1.0:1787602514.272934:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787602514.272943:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874436838990592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787602514.272976:0:8475:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1787602514.272998:0:8475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.273019:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af4756e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350035 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.273028:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787602514.273031:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602514.273063:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.273098:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af4756e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350035 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.273113:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af4756e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350035 expref: 12 pid: 6693 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602514.273145:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a41326680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1874436838990848:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602514.273214:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a57d6c480 going to sleep for 11 seconds 00000100:00080000:0.0:1787602514.274009:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602514.274765:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874436838990464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3083us (3248us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787602514.274777:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1787602514.274822:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602514.274831:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b76aa85/0x576b7af90af477ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.274843:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602514.274854:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b76aa85/0x576b7af90af477ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.274865:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b76aa85/0x576b7af90af477ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.274889:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b76aa85/0x576b7af90af477ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.274897:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b76aa85/0x576b7af90af477ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.274922:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602514.274924:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602514.274926:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602514.274945:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a41327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838990720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787602514.276473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602514.276665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.279114:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838990720 00000100:00100000:3.0:1787602514.279132:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838990720 00000100:00100000:3.0:1787602514.279210:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821184896 00000100:00100000:3.0:1787602514.279214:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821184896 00000100:00100000:3.0:1787602514.279240:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787602514.279251:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1874436838990720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787602514.279695:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787602514.279699:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787602513 00002000:00010000:3.0:1787602514.279702:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787602514.279705:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787602513 -> 1787602513 00002000:00010000:3.0:1787602514.279729:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787602514.280094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602514.280159:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a41326680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1874436838990848:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602514.280190:0:8475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602514.280468:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1874436838990720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1217us (4000us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787602514.280479:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787602514.280512:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 68 00000100:00100000:3.0:1787602514.280524:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:2361:x1874436821184896:12345-192.168.206.25@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1787602514.280610:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a4d3d8380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787602514.280617:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838990464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787602514.284457:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821185024 00000100:00100000:0.0:1787602514.284479:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821185024 00010000:00010000:0.0:1787602514.284539:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af4756e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350035 expref: 14 pid: 6693 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602514.284599:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 84 00000100:00100000:0.0:1787602514.284611:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+14:2361:x1874436821185024:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602514.284632:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602514.284640:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af4756e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350035 expref: 14 pid: 6693 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.284656:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af4756e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350035 expref: 14 pid: 6693 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.284685:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfeec0a/0x576b7af90af4756e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350035 expref: 14 pid: 6693 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.284715:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602514.284720:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602514.284727:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.284739:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.284773:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602514.284855:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+13:2361:x1874436821185024:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 245us (4764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602514.284864:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 84 00010000:00010000:1.0:1787602514.285027:0:8475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.285067:0:8475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.285079:0:8475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.285088:0:8475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.285108:0:8475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787602514.289348:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a41327100/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787602514.289366:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a41327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838990720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787602514.290147:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3314:x1874436838990592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17200us (17372us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787602514.290160:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1787602514.290201:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602514.290226:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.290242:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602514.290249:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.290267:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.290293:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.290301:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad0682c/0x576b7af90af477b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.290326:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602514.290328:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602514.290329:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787602514.291630:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a41327480/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787602514.291645:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a41327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838990592:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787602514.317975:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1787602514.318017:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1787602514.318358:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821184896:12345-192.168.206.25@tcp:16:lhsmtool_posix.0 Request processed in 37828us (41686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.318373:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 68 00000100:00100000:1.0:1787602514.322203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.322455:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821185280 00000100:00100000:2.0:1787602514.322468:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821185280 00000100:00100000:2.0:1787602514.322538:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 228 00000100:00100000:2.0:1787602514.322552:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:11613:x1874436821185280:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787602514.322623:0:9459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602514.322658:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af47797 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c8 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.322683:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48947c00) 00010000:00010000:2.0:1787602514.322709:0:9459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602514.322757:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.322776:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.322788:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602514.323430:0:9459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004483fb5d reply state 0000000022235830 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602514.323445:0:9459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602514.323587:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:11613:x1874436821185280:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 1038us (1398us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787602514.323596:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 228 00000100:00100000:1.0:1787602514.326687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00010000:00010000:3.0:1787602514.327184:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.327199:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.327208:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.327215:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40031a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602514.327221:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.327230:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.327275:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48947c00) 00010000:00010000:3.0:1787602514.327278:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602514.327283:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.327291:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602514.327469:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821185408 00000100:00100000:2.0:1787602514.327480:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821185408 00000100:00100000:2.0:1787602514.327571:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 69 00000100:00100000:2.0:1787602514.327585:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2361:x1874436821185408:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787602514.327846:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787602514.327849:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787602513 -> 1787602512 00002000:00010000:2.0:1787602514.327852:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787602512 00002000:00010000:2.0:1787602514.327854:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787602513 -> 1787602512 00002000:00010000:2.0:1787602514.327856:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787602514.327932:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2361:x1874436821185408:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 Request processed in 349us (1258us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787602514.327941:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 69 00000100:00100000:1.0:1787602514.329946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.330123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821185664 00000100:00100000:2.0:1787602514.330135:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821185664 00000100:00100000:2.0:1787602514.330194:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 229 00000100:00100000:2.0:1787602514.330206:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:11613:x1874436821185664:12345-192.168.206.25@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787602514.330305:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.330326:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ba expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.330338:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.330383:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ba expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.330407:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ba expref: 20 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602514.330425:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e949f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838990976:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602514.330535:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48e729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602514.333242:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e949f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874436838990976:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602514.333290:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602514.334316:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.334688:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821185792 00000100:00100000:3.0:1787602514.334699:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821185792 00010000:00010000:3.0:1787602514.334750:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ba expref: 21 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602514.334794:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 85 00000100:00100000:3.0:1787602514.334805:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:2361:x1874436821185792:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602514.334823:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602514.334831:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ba expref: 21 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.334846:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ba expref: 21 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.334872:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030a00/0x576b7af90af4777b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500ba expref: 21 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.334893:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48947c00) 00010000:00010000:3.0:1787602514.334898:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.334925:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.334933:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.335304:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602514.335659:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.335670:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.335724:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.335732:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.335739:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.335746:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40031000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602514.335751:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.335760:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.335773:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48947c00) 00010000:00010000:1.0:1787602514.335775:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787602514.335780:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.335785:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af477c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602514.335882:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:11613:x1874436821185664:12345-192.168.206.25@tcp:55:lhsmtool_posix.0 Request processed in 5676us (5945us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787602514.335893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 229 00000100:00100000:3.0:1787602514.338564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602514.338655:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821185920 00000100:00100000:1.0:1787602514.338668:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821185920 00000100:00100000:1.0:1787602514.338739:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 70 00000100:00100000:1.0:1787602514.338769:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2362:x1874436821185920:12345-192.168.206.25@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787602514.338827:0:8475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.338853:0:8475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.338863:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602514.338868:0:8475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602514.338873:0:8475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.338915:0:8475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.338931:0:8475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 8 pid: 6694 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602514.338947:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a41325c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1874436838991104:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602514.339090:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a42c793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602514.340727:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:2361:x1874436821185792:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 5540us (6035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602514.340745:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 85 00000100:00100000:1.0:1787602514.343136:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a41325c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8475:1874436838991104:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602514.343180:0:8475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602514.347832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602514.347931:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821186048 00000100:00100000:1.0:1787602514.347971:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821186048 00010000:00010000:1.0:1787602514.348023:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 9 pid: 6694 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602514.348101:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 86 00000100:00100000:1.0:1787602514.348113:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+9:2362:x1874436821186048:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602514.348133:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602514.348166:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 9 pid: 6694 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.348184:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 9 pid: 6694 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.348214:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d6be05d/0x576b7af90af477a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500d6 expref: 9 pid: 6694 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.348236:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602514.348241:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602514.348248:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.348267:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.348305:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602514.348371:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2362:x1874436821186048:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 260us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602514.348390:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 86 00010000:00010000:3.0:1787602514.348570:0:8475:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.348582:0:8475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.348611:0:8475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.348620:0:8475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.348629:0:8475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.348637:0:8475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ce00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602514.348641:0:8475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.348664:0:8475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.348677:0:8475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.348685:0:8475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da73bdbb/0x576b7af90af477c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602514.348754:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821185920:12345-192.168.206.25@tcp:1:lhsmtool_posix.0 Request processed in 9987us (10204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.348763:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 70 00000100:00100000:0.0:1787602514.352088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.352241:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821186304 00000100:00100000:2.0:1787602514.352254:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821186304 00000100:00100000:2.0:1787602514.352333:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 230 00000100:00100000:2.0:1787602514.352345:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:11613:x1874436821186304:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787602514.352476:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.352498:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.352512:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.352779:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.352791:0:9459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47789 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c1 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.352800:0:9459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.352847:0:9459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47789 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c1 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.352863:0:9459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47789 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c1 expref: 20 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602514.352880:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e949f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838991232:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602514.352985:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48e729c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602514.356655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.356782:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e949f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838991232:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602514.356816:0:9459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602514.356885:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821186432 00000100:00100000:3.0:1787602514.356895:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821186432 00010000:00010000:3.0:1787602514.356939:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47789 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c1 expref: 21 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602514.356988:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 87 00000100:00100000:3.0:1787602514.356999:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:2362:x1874436821186432:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602514.357016:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602514.357024:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47789 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c1 expref: 21 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.357070:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47789 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c1 expref: 21 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.357120:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af47789 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500c1 expref: 21 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.357139:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48947c00) 00010000:00010000:3.0:1787602514.357144:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.357154:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.357162:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.357188:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602514.357246:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:2362:x1874436821186432:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 248us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.357267:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 87 00010000:00010000:1.0:1787602514.357516:0:9459:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.357525:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602514.357767:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787602514.357935:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787602514.357979:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787602514.358100:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a41325c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838991360:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787602514.358172:0:9459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602514.358206:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787602514.358794:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838991360 00000100:00100000:3.0:1787602514.358803:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838991360 00000100:00100000:3.0:1787602514.358872:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602514.358883:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9459:x1874436838991360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787602514.359009:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9459:x1874436838991360:12345-0@lo:1000:mdt00_003.0 Request processed in 127us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.359017:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787602514.359463:0:9459:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1787602514.359470:0:9459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1787602514.359494:0:9459:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944a41327100, transno 4294967321 00000100:00100000:1.0:1787602514.359519:0:9459:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff944a41327480 x1874436838990592/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787602530 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602514.359532:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a41325c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838991360:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787602514.360154:0:9459:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787602514.360326:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a41325c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838991488:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787602514.360384:0:9459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602514.360435:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602514.361119:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838991488 00000100:00100000:0.0:1787602514.361130:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838991488 00000100:00100000:0.0:1787602514.361193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787602514.361205:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9459:x1874436838991488:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787602514.361476:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9459:x1874436838991488:12345-0@lo:1000:mdt00_003.0 Request processed in 273us (1090us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787602514.361484:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787602514.361770:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a41325c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9459:1874436838991488:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787602514.361822:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.361850:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.361859:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.361865:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40031a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602514.361870:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.361878:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.361899:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48947c00) 00010000:00010000:1.0:1787602514.361902:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787602514.361908:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.361915:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031a00/0x576b7af90af477d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.361958:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.361979:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.361986:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.361991:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602514.362002:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.362009:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.362017:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602514.362020:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787602514.362029:0:9459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500a5 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.362130:0:9459:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47720 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500a5 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.362140:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500a5 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.362181:0:9459:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500a5 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602514.362196:0:9459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a41327100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838991616:192.168.206.25@tcp:105: 00000100:00100000:1.0:1787602514.362541:0:9459:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602514.366483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.366568:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821186560 00000100:00100000:3.0:1787602514.366580:0:12533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821186560 00000100:00100000:3.0:1787602514.366646:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 61 00000100:00100000:3.0:1787602514.366660:0:12533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:11612:x1874436821186560:12345-192.168.206.25@tcp:49:lfs.0 00000100:00100000:3.0:1787602514.366849:0:12533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:11612:x1874436821186560:12345-192.168.206.25@tcp:49:lfs.0 Request processed in 192us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.366857:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 61 00000100:00100000:0.0:1787602514.369177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602514.369334:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821186816 00000100:00100000:1.0:1787602514.369345:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821186816 00000100:00100000:1.0:1787602514.369425:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 231 00000100:00100000:1.0:1787602514.369437:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:11612:x1874436821186816:12345-192.168.206.25@tcp:58:lfs.0 00000040:00080000:1.0:1787602514.370603:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787602514.370825:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:11612:x1874436821186816:12345-192.168.206.25@tcp:58:lfs.0 Request processed in 1386us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602514.370838:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 231 00000100:00100000:2.0:1787602514.370969:0:9459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a41327100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9459:1874436838991616:192.168.206.25@tcp:105: 00010000:00010000:2.0:1787602514.371001:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371013:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71200/0x576b7af90af47719 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371085:0:9459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371103:0:9459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371115:0:9459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371126:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371133:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371139:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371145:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40030600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602514.371149:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371169:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371183:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602514.371187:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602514.371191:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371197:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371210:0:9459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371216:0:9459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371222:0:9459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371227:0:9459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40030e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602514.371230:0:9459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371235:0:9459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371243:0:9459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602514.371246:0:9459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787602514.371249:0:9459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.371277:0:9459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602514.371443:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:11613:x1874436821186304:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 19100us (19421us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787602514.371452:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 230 00000020:00080000:2.0:1787602514.371455:0:9459:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787602514.371643:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602514.371649:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602514.371686:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787602514.371694:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787602514.371823:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a41327b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838991744:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787602514.371881:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc540 going to sleep for 11 seconds 00000100:00100000:1.0:1787602514.381688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602514.381754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602514.382073:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821187072 00000100:00100000:0.0:1787602514.382086:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821187072 00000100:00100000:0.0:1787602514.382168:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 62 00000100:00100000:0.0:1787602514.382181:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a50589850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+24:11613:x1874436821187072:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787602514.383649:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787602514.383788:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787602514.383857:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.383876:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.383888:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.383896:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.383902:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.383909:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.383939:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787602514.384173:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821187200 00000100:00100000:3.0:1787602514.384185:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821187200 00000100:00100000:3.0:1787602514.384245:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 232 00000100:00100000:3.0:1787602514.384267:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:11614:x1874436821187200:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787602514.384316:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787602514.384461:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:11614:x1874436821187200:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 206us (2705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.384470:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 232 00010000:00010000:1.0:1787602514.384810:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602514.384820:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.384828:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602514.384833:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.384841:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.384857:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff944a48acee00) 00010000:00010000:1.0:1787602514.384860:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787602514.384865:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.384872:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af477e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.384893:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602514.384905:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602514.384907:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602514.385556:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a50589850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+26:11613:x1874436821187072:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 3370us (3875us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787602514.385569:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 62 00000020:00080000:0.0:1787602514.385573:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787602514.397547:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a41327b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11691:1874436838991744:192.168.206.25@tcp:107:hsm_cdtr.0 00010000:00010000:3.0:1787602514.398215:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602514.399623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.399765:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821187456 00000100:00100000:2.0:1787602514.399778:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821187456 00000100:00100000:2.0:1787602514.399857:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 233 00000100:00100000:2.0:1787602514.399869:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+25:11614:x1874436821187456:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602514.399898:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602514.399926:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500dd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.400105:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.400123:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.400138:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602514.400153:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787602514.400313:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030e00/0x576b7af90af477eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500dd expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.400444:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500dd expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602514.400456:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602514.400459:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787602514.400462:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a40030600, rc 0) 00000100:00100000:2.0:1787602514.400604:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:11614:x1874436821187456:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 736us (993us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787602514.400613:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 233 00000100:00100000:2.0:1787602514.406801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602514.412167:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821187584 00000100:00100000:0.0:1787602514.412190:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821187584 00000100:00100000:0.0:1787602514.412297:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 234 00000100:00100000:0.0:1787602514.412310:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+27:11616:x1874436821187584:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602514.412338:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602514.412393:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47800 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.412487:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47807 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.412505:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47807 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.412519:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47807 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.412535:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4780e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.412543:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4780e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.412548:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4780e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.412924:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.412938:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235009e expref: 28 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.412946:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.412990:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235009e expref: 28 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.413017:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235009e expref: 28 pid: 9459 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602514.413081:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a75617100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838991872:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602514.413222:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602514.416732:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.416819:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821187840 00000100:00100000:3.0:1787602514.416831:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821187840 00000100:00100000:3.0:1787602514.416894:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 63 00000100:00100000:3.0:1787602514.416905:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:5598:x1874436821187840:12345-192.168.206.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787602514.417247:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:5598:x1874436821187840:12345-192.168.206.25@tcp:35:ldlm_bl.0 Request processed in 341us (527us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787602514.417261:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 63 00000100:00100000:0.0:1787602514.419013:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a75617100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874436838991872:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602514.419074:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602514.419417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602514.419602:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821188096 00000100:00100000:1.0:1787602514.419611:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821188096 00000100:00100000:1.0:1787602514.419674:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 235 00000100:00100000:1.0:1787602514.419686:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:11614:x1874436821188096:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787602514.419782:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4781c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.419801:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4781c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.419813:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4781c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602514.420901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602514.421244:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821188224 00000100:00100000:3.0:1787602514.421312:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821188224 00010000:00010000:3.0:1787602514.421434:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235009e expref: 32 pid: 9459 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602514.421485:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 88 00000100:00100000:3.0:1787602514.421496:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:2361:x1874436821188224:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602514.421533:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602514.421542:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235009e expref: 32 pid: 9459 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.421557:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235009e expref: 32 pid: 9459 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.421582:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d800/0x576b7af90af4770b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235009e expref: 32 pid: 9459 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.421604:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602514.421611:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.421621:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.421629:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.421857:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4781c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.421867:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4781c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.421874:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4781c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.421879:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602514.421885:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4781c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.421894:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4781c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602514.421917:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:1.0:1787602514.421919:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787602514.421924:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4781c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602514.421928:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602514.421930:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af4781c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602514.422015:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+31:2361:x1874436821188224:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 520us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.422022:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 88 00000100:00100000:1.0:1787602514.422434:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:11614:x1874436821188096:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 2749us (3016us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787602514.422511:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 235 00000040:00080000:3.0:1787602514.422624:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602514.422630:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:0.0:1787602514.422860:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.422870:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602514.422918:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787602514.422922:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602514.423007:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423022:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423032:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47807 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423056:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47807 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423079:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423085:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602514.423089:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47807 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423096:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47807 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423108:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:0.0:1787602514.423112:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602514.423115:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423122:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423135:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4780e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787602514.423141:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00010000:00010000:0.0:1787602514.423141:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4780e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423147:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4780e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787602514.423150:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787602514.423152:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602514.423154:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4780e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423177:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4780e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423185:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff944a48ace800) 00010000:00010000:0.0:1787602514.423187:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602514.423189:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4780e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423195:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459a00/0x576b7af90af4780e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423246:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47800 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500e4 expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423262:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500e4 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602514.423872:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602514.423875:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602514.423878:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459600, rc 0) 00000100:00100000:0.0:1787602514.424027:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:11616:x1874436821187584:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 11718us (17238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602514.424118:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 234 00000100:00100000:0.0:1787602514.428403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602514.428836:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821188480 00000100:00100000:2.0:1787602514.428850:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821188480 00000100:00100000:2.0:1787602514.429032:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 64 00000100:00100000:2.0:1787602514.429073:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+29:11614:x1874436821188480:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787602514.429429:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:11614:x1874436821188480:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 357us (1394us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787602514.429439:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 64 00000040:00080000:1.0:1787602515.279773:0:12574:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602515.279787:0:12574:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602515.279840:0:12574:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787602515.279848:0:12574:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787602515.421154:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602515.486827:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838992000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602515.486947:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602515.487062:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838992000 00000100:00100000:3.0:1787602515.487072:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838992000 00000100:00100000:3.0:1787602515.487134:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787602515.487145:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874436838992000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602515.487173:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787602515.487228:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874436838992000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602515.487235:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787602515.487295:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838992000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602515.487587:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6ebc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838992384:0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.487626:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602515.487657:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787602515.487663:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838992512:0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.487704:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602515.487733:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e94b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838992256:0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.487759:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602515.487779:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787602515.487784:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838992128:0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.487812:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602515.487835:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944946feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838992640:0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.487857:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602515.487882:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838992384 00000100:00100000:2.0:1787602515.487888:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838992384 00000100:00100000:2.0:1787602515.487932:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838992256 00000100:00100000:2.0:1787602515.487935:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838992256 00000100:00100000:2.0:1787602515.487951:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838992640 00000100:00100000:2.0:1787602515.487954:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838992640 00000100:00100000:2.0:1787602515.487970:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787602515.487977:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838992384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.488078:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436838992384:12345-0@lo:400:kworker.0 Request processed in 101us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602515.488095:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787602515.488112:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787602515.488118:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838992256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.488150:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838992256:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602515.488156:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787602515.488168:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787602515.488174:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a60406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838992640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.488217:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a60406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436838992640:12345-0@lo:400:kworker.0 Request processed in 44us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602515.488224:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787602515.488245:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838992512 00000100:00100000:2.0:1787602515.488249:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838992512 00000100:00100000:2.0:1787602515.488278:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787602515.488284:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1874436838992512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.488316:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1874436838992512:12345-0@lo:400:kworker.0 Request processed in 32us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602515.488322:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787602515.488356:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838992128 00000100:00100000:2.0:1787602515.488360:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838992128 00000100:00100000:2.0:1787602515.488387:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787602515.488404:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a468fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838992128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.488436:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a468fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3314:x1874436838992128:12345-0@lo:400:kworker.0 Request processed in 33us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602515.488442:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:2.0:1787602515.488474:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602515.488478:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602515.488513:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838992128:0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.488527:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944946feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838992640:0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.488536:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e94b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838992256:0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.488569:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838992512:0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.488580:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6ebc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436838992384:0@lo:400:kworker.0 00000100:00100000:2.0:1787602515.491236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602515.491550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821188736 00000100:00100000:3.0:1787602515.491562:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821188736 00000100:00100000:3.0:1787602515.491639:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 236 00000100:00100000:3.0:1787602515.491651:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+30:11640:x1874436821188736:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602515.491683:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602515.491709:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af47823 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500eb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602515.491837:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4782a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602515.491854:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4782a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602515.491867:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4782a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602515.491880:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787602515.492086:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70400/0x576b7af90af47823 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500eb expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602515.492106:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4782a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500eb expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602515.492117:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:3.0:1787602515.492120:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787602515.492124:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70200, rc 0) 00000100:00100000:3.0:1787602515.492199:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ebc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:11640:x1874436821188736:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 550us (975us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787602515.492206:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 236 00000100:00100000:2.0:1787602515.498006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602515.498378:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821188864 00000100:00100000:0.0:1787602515.498400:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821188864 00000100:00100000:0.0:1787602515.498478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 237 00000100:00100000:0.0:1787602515.498490:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:11640:x1874436821188864:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:0.0:1787602515.498588:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47838 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602515.498611:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602515.498626:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602515.498660:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602515.498667:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47838 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602515.498675:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602515.499544:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602515.499555:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602515.499567:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602515.499583:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:0.0:1787602515.499586:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602515.499591:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47838 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602515.499598:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459800/0x576b7af90af47838 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602515.499726:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+32:11640:x1874436821188864:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 1235us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602515.499736:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 237 00000100:00100000:1.0:1787602515.607828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602515.607949:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821188992 00000100:00100000:2.0:1787602515.607962:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821188992 00000100:00100000:2.0:1787602515.608075:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 71 00000100:00100000:2.0:1787602515.608089:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821188992:12345-192.168.206.25@tcp:101:cat.0 00010000:00010000:2.0:1787602515.608113:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602515.608142:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074ede597/0x576b7af90af4783f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500f2 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602515.608176:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8ca650, atime: 0x6a8ca650, ctime: 0x6a8ca650, blocks: 0xb 00010000:00010000:2.0:1787602515.608199:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=346s v=(0 0) 00010000:00010000:2.0:1787602515.608205:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602515.608217:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074ede597/0x576b7af90af4783f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500f2 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602515.608239:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074ede597/0x576b7af90af4783f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500f2 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602515.608254:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a40030a00, rc 0) 00000100:00100000:2.0:1787602515.608323:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2362:x1874436821188992:12345-192.168.206.25@tcp:101:cat.0 Request processed in 237us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602515.608331:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 71 00000100:00100000:0.0:1787602515.611801:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602515.612318:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821189120 00000100:00100000:3.0:1787602515.612380:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821189120 00002000:00100000:0.0:1787602515.612687:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff944a75614e00 x1874436821189120/t0(0) o3->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:351/0 lens 488/0 e 0 to 0 dl 1787602526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602515.612700:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a75614e00 with x1874436821189120 ext(0->4095) 00002000:00010000:0.0:1787602515.612708:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a75614e00 00000100:00100000:0.0:1787602515.612802:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:0.0:1787602515.612816:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2361:x1874436821189120:12345-192.168.206.25@tcp:3:cat.0 00000100:00100000:0.0:1787602515.613766:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+8:2361:x1874436821189120:12345-192.168.206.25@tcp:3:cat.0 Request processed in 944us (1973us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787602515.613778:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 7 00002000:00100000:0.0:1787602515.613789:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff944a75614e00 x1874436821189120/t0(0) o3->a41c7236-f364-42ee-9be0-a289b3ed94f6@192.168.206.25@tcp:351/0 lens 488/4536 e 0 to 0 dl 1787602526 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602515.613800:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff944a75614e00 with x1874436821189120 ext(0->4095) 00002000:00010000:0.0:1787602515.613805:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff944a75614e00 00000100:00100000:0.0:1787602515.720849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602515.720923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602515.720975:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821189248 00000100:00100000:2.0:1787602515.720989:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821189248 00000100:00100000:2.0:1787602515.721092:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 292 00000100:00100000:3.0:1787602515.721115:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821189376 00000100:00100000:2.0:1787602515.721118:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821189248:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602515.721120:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821189376 00000100:00100000:3.0:1787602515.721182:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 72 00000100:00100000:2.0:1787602515.721198:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821189248:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 83us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602515.721201:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a75616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2363:x1874436821189376:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602515.721206:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 292 00000100:00100000:3.0:1787602515.721231:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a75616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2363:x1874436821189376:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 42us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602515.721239:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 72 00000100:00080000:1.0:1787602515.721446:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602515.722823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602515.722908:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821189504 00000100:00100000:3.0:1787602515.722919:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821189504 00000100:00100000:3.0:1787602515.723002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 139 00000100:00100000:3.0:1787602515.723012:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a41324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2363:x1874436821189504:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602515.723122:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a41324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2363:x1874436821189504:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 111us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602515.723149:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 139 00000100:00080000:1.0:1787602515.724470:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602516.445233:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602517.022103:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838992768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602517.022218:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602517.022361:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838992768 00000100:00100000:3.0:1787602517.022372:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838992768 00000100:00100000:3.0:1787602517.022465:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787602517.022480:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944946feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874436838992768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602517.022525:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602517.022586:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944946feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874436838992768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602517.022594:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787602517.022810:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838992768:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787602517.022937:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787602517.469347:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787602518.088530:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1787602518.088552:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787602518.088558:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1787602518.495362:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602519.518157:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787602519.681420:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000001:00080000:3.0:1787602519.681443:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:3.0:1787602519.681455:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff944a488bc240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787602519.681460:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a7c566600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff944a488bc0c0 00000020:00080000:3.0:1787602519.681464:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff944a7c566100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff944a6eebf000 00000001:00080000:3.0:1787602519.681479:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1787602519.681496:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787602519.681505:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787602519.681516:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787602519.681723:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1787602519.694619:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1787602519.694648:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:3.0:1787602519.892517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602519.892858:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821189632 00000100:00100000:2.0:1787602519.892873:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821189632 00000100:00100000:2.0:1787602519.892974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 238 00000100:00100000:2.0:1787602519.892987:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:11293:x1874436821189632:12345-192.168.206.25@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787602519.893164:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:11293:x1874436821189632:12345-192.168.206.25@tcp:60:lhsmtool_posix.0 Request processed in 180us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602519.893173:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 238 00000100:00080000:1.0:1787602519.893476:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602519.895725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602519.896077:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821189888 00000100:00100000:1.0:1787602519.896091:0:12533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821189888 00000100:00100000:1.0:1787602519.896163:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 65 00000100:00100000:1.0:1787602519.896176:0:12533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:11293:x1874436821189888:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787602519.897797:0:12533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:11293:x1874436821189888:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 1613us (2072us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787602519.897811:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 65 00000100:00100000:3.0:1787602520.105348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602520.105581:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821190016 00000100:00100000:2.0:1787602520.105595:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821190016 00000100:00100000:2.0:1787602520.105743:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 239 00000100:00100000:2.0:1787602520.105757:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:12093:x1874436821190016:12345-192.168.206.25@tcp:101:lsof.0 00010000:00010000:2.0:1787602520.105783:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602520.105808:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af47846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123500f9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602520.105889:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af4784d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602520.105919:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af4784d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602520.105948:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af4784d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602520.106446:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787602520.106452:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602520.106626:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af4784d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602520.106660:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af47846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500f9 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602520.106681:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af4784d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500f9 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602520.106690:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88500) 00010000:00010000:2.0:1787602520.106693:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602520.106698:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a40030c00, rc 0) 00000100:00100000:2.0:1787602520.106769:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:12093:x1874436821190016:12345-192.168.206.25@tcp:101:lsof.0 Request processed in 1016us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602520.106777:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 239 00000100:00080000:1.0:1787602520.109653:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787602520.541873:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602520.605656:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436838993280:0@lo:400:kworker.0 00000100:00100000:1.0:1787602520.605745:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602520.605900:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787602520.605908:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838993152:0@lo:400:kworker.0 00000100:00100000:0.0:1787602520.605934:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838993280 00000100:00100000:1.0:1787602520.605940:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602520.605945:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838993280 00000100:00100000:1.0:1787602520.605963:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838993664:0@lo:400:kworker.0 00000100:00100000:1.0:1787602520.605994:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602520.606033:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838993152 00000100:00100000:1.0:1787602520.606077:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838993664 00000100:00100000:1.0:1787602520.606081:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838993664 00000100:00100000:0.0:1787602520.606085:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838993152 00000100:00100000:0.0:1787602520.606128:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787602520.606140:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436838993280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602520.606191:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787602520.606204:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838993664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602520.606210:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436838993280:12345-0@lo:400:kworker.0 Request processed in 71us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602520.606221:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787602520.606248:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838993664:12345-0@lo:400:kworker.0 Request processed in 46us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602520.606249:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787602520.606262:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787602520.606264:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838993152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602520.606304:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436838993152:12345-0@lo:400:kworker.0 Request processed in 44us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602520.606324:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1787602520.606325:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602520.606332:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602520.606383:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436838993152:0@lo:400:kworker.0 00000100:00100000:1.0:1787602520.608098:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787602520.608112:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944a41327480, transno 4294967322 00000100:00100000:2.0:1787602520.608376:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a41327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838992896:0@lo:400:kworker.0 00000100:00100000:2.0:1787602520.608468:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602520.608537:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838993408:0@lo:400:kworker.0 00000100:00100000:2.0:1787602520.608571:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602520.608619:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787602520.608679:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838992896 00000100:00100000:0.0:1787602520.608688:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838992896 00000100:00100000:0.0:1787602520.608738:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787602520.608749:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3311:x1874436838992896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602520.608805:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3311:x1874436838992896:12345-0@lo:400:kworker.0 Request processed in 58us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602520.608813:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000004:00080000:1.0:1787602520.608936:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787602520.608974:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838993664:0@lo:400:kworker.0 00000100:00100000:2.0:1787602520.610974:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838993024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602520.611077:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602520.611141:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838993536:0@lo:400:kworker.0 00000100:00100000:2.0:1787602520.611174:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602520.611219:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a41327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838992896:0@lo:400:kworker.0 00000100:00100000:2.0:1787602520.611279:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838993408 00000100:00100000:2.0:1787602520.611286:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838993408 00000100:00100000:2.0:1787602520.611354:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787602520.611378:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838993408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602520.611444:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838993408:12345-0@lo:400:kworker.0 Request processed in 80us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602520.611451:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787602520.611481:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838993024 00000100:00100000:2.0:1787602520.611485:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838993024 00000100:00100000:2.0:1787602520.611648:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787602520.611656:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838993024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602520.611690:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602520.611727:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436838993024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602520.611733:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787602520.611758:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602520.611790:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838993024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602520.611802:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787602520.611808:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787602520.611891:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff944a4d3d8380, transno 4294967310 00000100:00100000:2.0:1787602520.611921:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436838993408:0@lo:400:kworker.0 00000100:00100000:2.0:1787602520.612335:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838993536 00000100:00100000:2.0:1787602520.612340:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838993536 00000100:00100000:0.0:1787602520.612684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787602520.612697:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838993536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602520.612758:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838993536:12345-0@lo:400:kworker.0 Request processed in 65us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602520.612765:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787602520.612802:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838993536:0@lo:400:kworker.0 00000100:00080000:0.0:1787602520.612855:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602520.615730:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436838993280:0@lo:400:kworker.0 00000100:00100000:3.0:1787602520.835657:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602520.835711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602520.835750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602520.835792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602520.835904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602520.835949:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821190400 00000100:00100000:3.0:1787602520.835962:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821190400 00000100:00100000:3.0:1787602520.836089:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821190528 00000100:00100000:3.0:1787602520.836093:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821190528 00000100:00100000:3.0:1787602520.836123:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 75 00000100:00100000:3.0:1787602520.836135:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6ecd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821190400:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602520.836308:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821190656 00000100:00100000:2.0:1787602520.836313:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821190656 00000100:00100000:2.0:1787602520.836342:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821190272 00000100:00100000:2.0:1787602520.836345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821190272 00000100:00100000:2.0:1787602520.836374:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 143 00000100:00100000:2.0:1787602520.836381:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2364:x1874436821190656:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602520.836457:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2364:x1874436821190656:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 77us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602520.836465:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 143 00000100:00100000:2.0:1787602520.836482:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 144 00000100:00100000:2.0:1787602520.836489:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:2364:x1874436821190272:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602520.836521:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:2364:x1874436821190272:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 33us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602520.836527:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 144 00000100:00100000:2.0:1787602520.836568:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 76 00000100:00100000:2.0:1787602520.836576:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2364:x1874436821190528:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602520.836605:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2364:x1874436821190528:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 30us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602520.836611:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 76 00000100:00100000:0.0:1787602520.837638:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821190144 00000100:00100000:0.0:1787602520.837648:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821190144 00000100:00100000:0.0:1787602520.837711:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 294 00000100:00100000:0.0:1787602520.837719:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2364:x1874436821190144:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602520.837766:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2364:x1874436821190144:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 48us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602520.837773:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 294 00000100:00080000:0.0:1787602520.837821:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602520.837826:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602520.839715:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6ecd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2364:x1874436821190400:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 3529us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602520.839732:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 75 00010000:00010000:2.0:1787602521.566243:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602522.141753:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602522.141974:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838993792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602522.142109:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602522.142478:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838993792 00000100:00100000:2.0:1787602522.142502:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838993792 00000100:00100000:2.0:1787602522.142576:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787602522.142608:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838993792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602522.142657:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602522.142719:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838993792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602522.142727:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787602522.143280:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838993792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787602522.144569:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602522.589307:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787602523.356829:0:12776:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:15:21 (1787602521) 00010000:00010000:3.0:1787602523.615583:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602524.640297:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787602524.701272:0:11691:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602524.701282:0:11691:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602524.701706:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787602524.701712:0:11691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787602524.762367:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787602524.762383:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787602524.762452:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787602524.762463:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787602525.664307:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602525.725526:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838994304:0@lo:400:kworker.0 00000100:00100000:1.0:1787602525.725526:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838994048:0@lo:400:kworker.0 00000100:00100000:3.0:1787602525.725619:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838994176:0@lo:400:kworker.0 00000100:00100000:0.0:1787602525.728006:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838993920:0@lo:400:kworker.0 00000100:00100000:2.0:1787602525.728470:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602525.728559:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838994304 00000100:00100000:2.0:1787602525.728567:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838994304 00000100:00100000:2.0:1787602525.728860:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787602525.728868:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838994304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602525.728918:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838994304:12345-0@lo:400:kworker.0 Request processed in 50us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602525.728935:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787602525.728974:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838994304:0@lo:400:kworker.0 00000100:00080000:2.0:1787602525.729004:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602525.735169:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602525.735539:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838994432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602525.735593:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602525.735645:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838994432 00000100:00100000:1.0:1787602525.735652:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838994432 00000100:00100000:1.0:1787602525.735704:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787602525.735713:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7bee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838994432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602525.735758:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602525.735797:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7bee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436838994432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602525.735805:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1787602525.736316:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602525.736490:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436838994432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602525.737075:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602525.737109:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838993920 00000100:00100000:0.0:1787602525.737112:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838994560:0@lo:400:kworker.0 00000100:00100000:1.0:1787602525.737116:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838993920 00000100:00100000:0.0:1787602525.737150:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602525.737153:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787602525.737161:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3311:x1874436838993920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602525.737529:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3311:x1874436838993920:12345-0@lo:400:kworker.0 Request processed in 367us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602525.737548:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787602525.737908:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838994048 00000100:00100000:2.0:1787602525.737914:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838994048 00000100:00100000:0.0:1787602525.737952:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838993920:0@lo:400:kworker.0 00000100:00100000:1.0:1787602525.738018:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602525.742109:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838994688:0@lo:400:kworker.0 00000100:00100000:1.0:1787602525.742174:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602525.742381:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838994560 00000100:00100000:3.0:1787602525.742389:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838994560 00000100:00100000:3.0:1787602525.742444:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838994176 00000100:00100000:3.0:1787602525.742448:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838994176 00000100:00100000:3.0:1787602525.742487:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787602525.742495:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838994048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602525.742568:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436838994048:12345-0@lo:400:kworker.0 Request processed in 73us (7404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602525.742574:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787602525.742591:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787602525.742598:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838994560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602525.742634:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436838994560:12345-0@lo:400:kworker.0 Request processed in 36us (5484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602525.742640:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787602525.742660:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787602525.742668:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838994176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602525.742697:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436838994048:0@lo:400:kworker.0 00000100:00100000:3.0:1787602525.742705:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436838994176:12345-0@lo:400:kworker.0 Request processed in 38us (4687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602525.742714:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787602525.742734:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436838994176:0@lo:400:kworker.0 00000100:00100000:3.0:1787602525.742739:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838994688 00000100:00100000:3.0:1787602525.742744:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838994688 00000100:00100000:3.0:1787602525.742778:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787602525.742786:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838994688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602525.742790:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838994560:0@lo:400:kworker.0 00000100:00080000:1.0:1787602525.742815:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602525.742830:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436838994688:12345-0@lo:400:kworker.0 Request processed in 44us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602525.742838:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787602525.742850:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436838994688:0@lo:400:kworker.0 00000100:00100000:2.0:1787602525.957558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602525.957605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602525.957647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602525.957651:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821190912 00000100:00100000:1.0:1787602525.957660:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821190912 00000100:00100000:2.0:1787602525.957684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602525.957717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602525.957725:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821191296 00000100:00100000:1.0:1787602525.957729:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821191296 00000100:00100000:2.0:1787602525.957741:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821191168 00000100:00100000:1.0:1787602525.957757:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 148 00000100:00100000:2.0:1787602525.957759:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821191168 00000100:00100000:1.0:1787602525.957769:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:2362:x1874436821190912:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602525.957795:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821191040 00000100:00100000:2.0:1787602525.957800:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821191040 00000100:00100000:2.0:1787602525.957824:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 79 00000100:00100000:2.0:1787602525.957833:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821191168:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602525.957846:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:2362:x1874436821190912:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602525.957854:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 148 00000100:00100000:2.0:1787602525.957872:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2362:x1874436821191168:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602525.957877:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 149 00000100:00100000:2.0:1787602525.957884:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 79 00000100:00100000:1.0:1787602525.957900:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2361:x1874436821191296:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602525.957905:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 80 00000100:00100000:2.0:1787602525.957915:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821191040:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602525.957935:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2361:x1874436821191296:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 49us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602525.957943:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 149 00000100:00100000:2.0:1787602525.957947:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2361:x1874436821191040:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 33us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602525.957959:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 80 00000100:00080000:1.0:1787602525.957977:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602525.957982:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602525.957985:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602525.958079:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821190784 00000100:00100000:0.0:1787602525.958083:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821190784 00000100:00100000:0.0:1787602525.958115:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 296 00000100:00100000:0.0:1787602525.958122:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821190784:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602525.958150:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2361:x1874436821190784:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602525.958157:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 296 00000100:00100000:0.0:1787602526.503821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602526.504416:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821191552 00000100:00100000:3.0:1787602526.504433:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821191552 00000100:00100000:3.0:1787602526.504513:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 66 00000100:00100000:3.0:1787602526.504527:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+19:12314:x1874436821191552:12345-192.168.206.25@tcp:35:umount.0 00000100:00100000:3.0:1787602526.505700:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:12314:x1874436821191552:12345-192.168.206.25@tcp:35:umount.0 Request processed in 1169us (1880us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787602526.505713:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 66 00000100:00100000:1.0:1787602526.518085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602526.518422:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821191808 00000100:00100000:2.0:1787602526.518437:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821191808 00000100:00100000:2.0:1787602526.518517:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 67 00000100:00100000:2.0:1787602526.518531:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+20:12314:x1874436821191808:12345-192.168.206.25@tcp:35:umount.0 00000100:00100000:2.0:1787602526.519013:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:12314:x1874436821191808:12345-192.168.206.25@tcp:35:umount.0 Request processed in 484us (976us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787602526.519023:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 67 00000100:00100000:2.0:1787602526.523487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602526.524007:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821192064 00000100:00100000:3.0:1787602526.524025:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821192064 00000100:00100000:3.0:1787602526.524449:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 68 00000100:00100000:3.0:1787602526.524464:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a5058a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+21:12314:x1874436821192064:12345-192.168.206.25@tcp:35:umount.0 00000100:00100000:3.0:1787602526.525093:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a5058a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:12314:x1874436821192064:12345-192.168.206.25@tcp:35:umount.0 Request processed in 630us (1618us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787602526.525103:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 68 00000100:00100000:0.0:1787602526.528438:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602526.528537:0:12533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821192320 00000100:00100000:3.0:1787602526.528550:0:12533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821192320 00000100:00100000:3.0:1787602526.528663:0:12533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 69 00000100:00100000:3.0:1787602526.528680:0:12533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:12314:x1874436821192320:12345-192.168.206.25@tcp:35:umount.0 00000100:00100000:3.0:1787602526.529310:0:12533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:12314:x1874436821192320:12345-192.168.206.25@tcp:35:umount.0 Request processed in 630us (883us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787602526.529321:0:12533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 69 00000100:00100000:0.0:1787602526.535306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602526.535410:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602526.535550:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602526.535629:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821192448 00000100:00100000:3.0:1787602526.535648:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821192448 00000100:00100000:3.0:1787602526.535731:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821192704 00000100:00100000:3.0:1787602526.535735:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821192704 00000100:00100000:3.0:1787602526.535767:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00100000:3.0:1787602526.535778:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+14:2363:x1874436821192448:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602526.535797:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602526.535821:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41477000/0x576b7af90af468c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc84 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602526.535850:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602526.535926:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+13:2363:x1874436821192448:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 150us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602526.535935:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00100000:3.0:1787602526.535960:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00100000:3.0:1787602526.535967:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+12:2363:x1874436821192704:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602526.535974:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602526.535985:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41477c00/0x576b7af90af46aaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd4f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602526.535994:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602526.536012:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:2363:x1874436821192704:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 46us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602526.536019:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00100000:0.0:1787602526.537743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602526.537872:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821193088 00000100:00100000:1.0:1787602526.537882:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821193088 00000100:00100000:1.0:1787602526.537954:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 72 00000100:00100000:1.0:1787602526.537964:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+7:2360:x1874436821193088:12345-192.168.206.25@tcp:9:umount.0 00000020:00000080:1.0:1787602526.538002:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46dfe 00000020:00010000:1.0:1787602526.538011:0:6694:0:(genops.c:1921:obd_stale_export_put()) Put export ffff944a49f65800: total 0 00000100:00080000:1.0:1787602526.538016:0:6694:0:(import.c:65:import_set_state_nolock()) ffff944a49f60800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787602526.538085:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787602526.538431:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2360:x1874436821193088:12345-192.168.206.25@tcp:9:umount.0 Request processed in 467us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602526.538439:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 72 00000020:00010000:1.0:1787602526.538463:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff944a49f65800: total 0 00010000:00010000:1.0:1787602526.538483:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff944a49f65800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787602526.538543:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074ede597/0x576b7af90af4783f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500f2 expref: 4 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602526.538577:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054e28202/0x576b7af90af471a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff24 expref: 3 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602526.538592:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff944a49f65800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787602526.538602:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602526.538604:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602526.538605:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602526.540498:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821192576 00000100:00100000:2.0:1787602526.540518:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821192576 00000100:00100000:2.0:1787602526.540613:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:2.0:1787602526.540625:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:2363:x1874436821192576:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602526.540676:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602526.540699:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d71600/0x576b7af90af4682b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc4c expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.540718:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602526.540777:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2363:x1874436821192576:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 154us (5226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602526.540785:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:0.0:1787602526.552821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602526.553213:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821193216 00000100:00100000:3.0:1787602526.553227:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821193216 00000100:00100000:3.0:1787602526.553306:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 73 00000100:00100000:3.0:1787602526.553319:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+5:2360:x1874436821193216:12345-192.168.206.25@tcp:9:umount.0 00000020:00000080:3.0:1787602526.553372:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46b9d 00000100:00080000:3.0:1787602526.553383:0:6693:0:(import.c:65:import_set_state_nolock()) ffff944a7c515000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787602526.553439:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1787602526.553607:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602526.554230:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a41c7236-f364-42ee-9be0-a289b3ed94f6+2:2360:x1874436821193216:12345-192.168.206.25@tcp:9:umount.0 Request processed in 909us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602526.554241:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 73 00000100:00100000:0.0:1787602526.574775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602526.574850:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821194240 00000100:00100000:1.0:1787602526.574893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821194240 00000100:00100000:1.0:1787602526.574980:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 240 00000100:00100000:1.0:1787602526.574993:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+23:2360:x1874436821194240:12345-192.168.206.25@tcp:39:umount.0 00000020:00000080:1.0:1787602526.575087:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46839 00000020:00010000:1.0:1787602526.575105:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff944a7554d000: total 0 00000100:00080000:1.0:1787602526.575110:0:5833:0:(import.c:65:import_set_state_nolock()) ffff944a7554a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787602526.575139:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1787602526.575610:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a41c7236-f364-42ee-9be0-a289b3ed94f6+22:2360:x1874436821194240:12345-192.168.206.25@tcp:39:umount.0 Request processed in 617us (859us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787602526.575619:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 240 00000020:00010000:2.0:1787602526.576188:0:8453:0:(genops.c:1907:obd_stale_export_get()) Get export ffff944a7554d000: total 0 00010000:00010000:2.0:1787602526.576244:0:8453:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff944a7554d000, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1787602526.576287:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602526.576291:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602526.576302:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47082 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fed7 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576325:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:2.0:1787602526.576336:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787602526.576341:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af46b73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd79 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576362:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602526.576364:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602526.576368:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500a5 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576379:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602526.576381:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602526.576396:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47815 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500e4 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576411:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602526.576413:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787602526.576416:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030600/0x576b7af90af477f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500dd expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576428:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88500) 00010000:00010000:2.0:1787602526.576429:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602526.576433:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71c00/0x576b7af90af47203 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff40 expref: 16 pid: 9459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576444:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48947000) 00010000:00010000:2.0:1787602526.576446:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602526.576450:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476a00/0x576b7af90af46b1f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd64 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576478:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602526.576481:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787602526.576485:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41476000/0x576b7af90af4718c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff1d expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576497:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff944a48947900) 00010000:00010000:2.0:1787602526.576499:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787602526.576502:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70200/0x576b7af90af4782a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500eb expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576516:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff944a4a576400) 00010000:00010000:2.0:1787602526.576525:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602526.576530:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47162 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff0f expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576549:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff944a4a576100) 00010000:00010000:2.0:1787602526.576552:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602526.576556:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d70000/0x576b7af90af46b03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd5d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576572:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602526.576575:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787602526.576579:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af4721f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234ff47 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576591:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff944a43b20c00) 00010000:00010000:2.0:1787602526.576594:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787602526.576597:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41477600/0x576b7af90af474fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350019 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576610:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff944a43b20300) 00010000:00010000:2.0:1787602526.576612:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787602526.576615:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458c00/0x576b7af90af46e60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fe4b expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602526.576626:0:8453:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff944a7554d000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1787602526.576640:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602526.576643:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602526.576644:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602526.685316:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602527.261539:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838994816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602527.261668:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602527.261828:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838994816 00000100:00100000:3.0:1787602527.261845:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838994816 00000100:00100000:3.0:1787602527.261928:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787602527.261941:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838994816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602527.261990:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602527.262084:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436838994816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602527.262092:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787602527.262150:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436838994816:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787602527.262505:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787602527.710233:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787602528.336147:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:0.0:1787602528.336161:0:6717:0:(genops.c:885:class_export_put()) final put ffff944a7c513800/a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:0.0:1787602528.336206:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c513800/a41c7236-f364-42ee-9be0-a289b3ed94f6 for lustre-OST0000 00000020:00000080:0.0:1787602528.336264:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a7c515000 for lustre-OST0000 00000100:00100000:0.0:1787602528.383295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602528.383376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602528.383478:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821194368 00000100:00100000:1.0:1787602528.383491:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821194368 00000100:00100000:1.0:1787602528.383575:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821194496 00000100:00100000:1.0:1787602528.383579:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821194496 00000100:00100000:1.0:1787602528.383619:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 20 00000100:00100000:1.0:1787602528.383631:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:79237443-cd99-4e6f-9597-f72f9f4e4ed2+11:2364:x1874436821194368:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602528.383650:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602528.383674:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890c600/0x576b7af90af4690b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc99 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602528.383697:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602528.383758:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:79237443-cd99-4e6f-9597-f72f9f4e4ed2+10:2364:x1874436821194368:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 129us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602528.383767:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 20 00000100:00100000:1.0:1787602528.383787:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00100000:1.0:1787602528.383795:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:79237443-cd99-4e6f-9597-f72f9f4e4ed2+9:2364:x1874436821194496:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602528.383820:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602528.383831:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5011da00/0x576b7af90af46aa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fd48 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602528.383841:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602528.383861:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:2364:x1874436821194496:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 67us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602528.383868:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00100000:0.0:1787602528.388890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602528.388980:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821194624 00000100:00100000:1.0:1787602528.388993:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821194624 00000100:00100000:1.0:1787602528.389114:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 22 00000100:00100000:1.0:1787602528.389126:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6022dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+8:2363:x1874436821194624:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602528.389145:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602528.389171:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d71800/0x576b7af90af46912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fcc3 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602528.389202:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602528.389280:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6022dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79237443-cd99-4e6f-9597-f72f9f4e4ed2+7:2363:x1874436821194624:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 155us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602528.389288:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 22 00000100:00100000:0.0:1787602528.395188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602528.395279:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821194880 00000100:00100000:3.0:1787602528.395292:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821194880 00000100:00100000:3.0:1787602528.395385:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 241 00000100:00100000:3.0:1787602528.395400:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+6:2360:x1874436821194880:12345-192.168.206.25@tcp:39:umount.0 00000020:00000080:3.0:1787602528.395452:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46920 00000020:00010000:3.0:1787602528.395462:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff944a7c47e000: total 0 00000100:00080000:3.0:1787602528.395467:0:5835:0:(import.c:65:import_set_state_nolock()) ffff944a7c47d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787602528.395505:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1787602528.395753:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc1a79-d388-4b93-8c58-223a06e0bf6b+5:2360:x1874436821194880:12345-192.168.206.25@tcp:39:umount.0 Request processed in 357us (586us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787602528.395762:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 241 00000020:00010000:1.0:1787602528.395874:0:8453:0:(genops.c:1907:obd_stale_export_get()) Get export ffff944a7c47e000: total 0 00010000:00010000:1.0:1787602528.395878:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602528.395927:0:8453:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff944a7c47e000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787602528.395967:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88500) 00010000:00010000:1.0:1787602528.395971:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602528.395980:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40030c00/0x576b7af90af4784d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123500f9 expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602528.396026:0:8453:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff944a7c47e000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787602528.396092:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602528.396095:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602528.396097:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787602528.396247:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602528.420638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602528.420757:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821195136 00000100:00100000:1.0:1787602528.420770:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821195136 00000100:00100000:1.0:1787602528.420840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 297 00000100:00100000:1.0:1787602528.420853:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a464cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+7:2360:x1874436821195136:12345-192.168.206.25@tcp:251:umount.0 00000020:00000080:1.0:1787602528.420909:0:5828:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46816 00000020:00010000:1.0:1787602528.420919:0:5828:0:(genops.c:1921:obd_stale_export_put()) Put export ffff944a7554c800: total 0 00000100:00080000:1.0:1787602528.420924:0:5828:0:(import.c:65:import_set_state_nolock()) ffff944a7554e000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787602528.421021:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a464cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79237443-cd99-4e6f-9597-f72f9f4e4ed2+3:2360:x1874436821195136:12345-192.168.206.25@tcp:251:umount.0 Request processed in 170us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602528.421031:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 297 00000020:00010000:3.0:1787602528.421196:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff944a7554c800: total 0 00010000:00010000:3.0:1787602528.421257:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff944a7554c800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787602528.421299:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d70e00/0x576b7af90af468cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1234fc8b expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602528.421315:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff944a7554c800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787602528.421339:0:5820:0:(genops.c:885:class_export_put()) final put ffff944a7554c800/79237443-cd99-4e6f-9597-f72f9f4e4ed2 00010000:00010000:3.0:1787602528.421361:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602528.421384:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602528.421386:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787602528.421839:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7554c800/79237443-cd99-4e6f-9597-f72f9f4e4ed2 for MGS 00000020:00000080:1.0:1787602528.421894:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a7554e000 for MGS 00010000:00010000:0.0:1787602528.733275:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602529.758334:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787602529.908325:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00000001:00080000:0.0:1787602529.908349:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1787602529.908366:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ebc1a79-d388-4b93-8c58-223a06e0bf6b 00000001:00080000:0.0:1787602529.908375:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787602529.908379:0:5855:0:(genops.c:885:class_export_put()) final put ffff944a7c47e000/3ebc1a79-d388-4b93-8c58-223a06e0bf6b 00000020:00000080:0.0:1787602529.908399:0:5855:0:(genops.c:885:class_export_put()) final put ffff944a7554d000/a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:0.0:1787602529.908415:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c47e000/3ebc1a79-d388-4b93-8c58-223a06e0bf6b for lustre-MDT0000 00000020:00000080:0.0:1787602529.908482:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7554d000/a41c7236-f364-42ee-9be0-a289b3ed94f6 for lustre-MDT0000 00000020:00000080:0.0:1787602529.908520:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a7c47d800 for lustre-MDT0000 00000020:00000080:0.0:1787602529.908526:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a7554a800 for lustre-MDT0000 00000001:00100000:1.0:1787602529.932777:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:1.0:1787602529.932790:0:7648:0:(genops.c:885:class_export_put()) final put ffff944a49f65800/a41c7236-f364-42ee-9be0-a289b3ed94f6 00000020:00000080:2.0:1787602529.932951:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a49f65800/a41c7236-f364-42ee-9be0-a289b3ed94f6 for lustre-OST0001 00000020:00000080:2.0:1787602529.933283:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a49f60800 for lustre-OST0001 00000020:01000004:2.0:1787602530.323933:0:12978:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787602530.339982:0:12978:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787602530.340514:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602530.340536:0:12978:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602530.340543:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602530.340551:0:12978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602530.340644:0:12978:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787602530.340652:0:12978:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787602530.340684:0:12978:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787602530.340690:0:12978:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787602530.340698:0:12978:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787602530.340732:0:12978:0:(import.c:65:import_set_state_nolock()) ffff944a46297000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787602530.340818:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874436838994944:0@lo:39:umount.0 00000100:00100000:3.0:1787602530.340916:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602530.342453:0:9459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838994944 00000100:00100000:2.0:1787602530.342471:0:9459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838994944 00000100:00100000:2.0:1787602530.342550:0:9459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787602530.342562:0:9459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874436838994944:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787602530.342618:0:9459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46625 00000100:00080000:2.0:1787602530.342630:0:9459:0:(import.c:65:import_set_state_nolock()) ffff944a488f7000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787602530.343464:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602530.343478:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.343506:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487600 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602530.343512:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.343522:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602530.343530:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602530.343536:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787602530.343539:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787602530.343543:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787602530.343591:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.343599:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602530.343633:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.343641:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41487600/0x576b7af90af4689b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af468a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.343659:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602530.343661:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602530.343663:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602530.343689:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838995072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602530.343768:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602530.343853:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838995072 00000100:00100000:0.0:1787602530.343867:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838995072 00000100:00100000:0.0:1787602530.343931:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787602530.343940:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3311:x1874436838995072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787602530.343956:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602530.343974:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d70600/0x576b7af90af468a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af4689b expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.343988:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602530.344029:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c5c99bea-fdac-431e-b440-876dfd3e206e+18:3311:x1874436838995072:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602530.344064:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787602530.344115:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838995072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602530.345586:0:9459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1874436838994944:12345-0@lo:39:umount.0 Request processed in 3018us (4662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602530.345601:0:9459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787602530.345616:0:9459:0:(genops.c:885:class_export_put()) final put ffff944a488f7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787602530.345663:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a488f7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787602530.345728:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a488f7000 for lustre-MDT0000 00010000:00010000:0.0:1787602530.345877:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787602530.346576:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a46297000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787602530.346644:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874436838994944:0@lo:39:umount.0 00000100:00080000:0.0:1787602530.353101:0:12978:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787602530.353114:0:12978:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787602530.353125:0:12978:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787602530.354103:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354122:0:12978:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354131:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354138:0:12978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354173:0:12978:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602530.354196:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354204:0:12978:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354210:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354216:0:12978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354229:0:12978:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787602530.354250:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602530.354256:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354263:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890d600 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602530.354268:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354277:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602530.354284:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602530.354290:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787602530.354293:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787602530.354349:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354366:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602530.354394:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354400:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5890d600/0x576b7af90af468a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af468b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354417:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602530.354421:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354427:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477a00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602530.354429:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354436:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602530.354441:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602530.354445:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787602530.354447:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787602530.354449:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787602530.354477:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354483:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602530.354505:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354521:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41477a00/0x576b7af90af467d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af467d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354534:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602530.354536:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602530.354538:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602530.354561:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838995200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602530.354643:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602530.354719:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354727:0:12978:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354733:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354739:0:12978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354752:0:12978:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602530.354760:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602530.354765:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354771:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890ce00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602530.354774:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354791:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602530.354797:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602530.354802:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787602530.354805:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787602530.354807:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787602530.354823:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354829:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602530.354836:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354841:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5890ce00/0x576b7af90af46ad2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af46ad9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354850:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602530.354852:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602530.354854:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602530.354866:0:12978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354873:0:12978:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354880:0:12978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354896:0:12978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354908:0:12978:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787602530.354912:0:12978:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787602530.354916:0:12978:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1787602530.354946:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602530.354949:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354956:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a81930200 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602530.354959:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354965:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602530.354971:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602530.354976:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787602530.354978:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787602530.354980:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787602530.354994:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.354999:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602530.355011:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.355028:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a81930200/0x576b7af90af46584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af4658b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602530.355076:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602530.355078:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602530.355080:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602530.355092:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838995584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602530.355123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787602530.355170:0:12978:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787602530.355176:0:12978:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787602530.355181:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602530.355188:0:12978:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787602530.355195:0:12978:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff944a46296800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787602530.355201:0:12978:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff944945807000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787602530.355206:0:12978:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff944a7c8f4d28) has exports, disconnecting them 00000020:00080000:0.0:1787602530.355211:0:12978:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff944a46296800), last request at 1787602525 00000020:00000080:0.0:1787602530.355219:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46798 00000100:00080000:0.0:1787602530.355239:0:12978:0:(import.c:65:import_set_state_nolock()) ffff944a576bc000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787602530.355279:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787602530.355293:0:12978:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff944a46296800): rc 0 00000020:00000080:0.0:1787602530.355296:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a46296800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787602530.355334:0:12978:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff944945807000), last request at 1787602525 00000020:00000080:0.0:1787602530.355338:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af466cd 00000100:00080000:0.0:1787602530.355344:0:12978:0:(import.c:65:import_set_state_nolock()) ffff944945802000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787602530.355356:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787602530.355363:0:12978:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff944945807000): rc 0 00000020:00000080:0.0:1787602530.355366:0:12978:0:(genops.c:885:class_export_put()) final put ffff944945807000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787602530.355382:0:12978:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbadb4193bae0 00000100:00080000:0.0:1787602530.355405:0:12978:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787602530.355408:0:12978:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787602530.355422:0:12978:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787602530.355492:0:12978:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787602530.355509:0:12978:0:(import.c:65:import_set_state_nolock()) ffff944a7c093800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787602530.355522:0:12978:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787602530.355525:0:12978:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787602530.355533:0:12978:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787602530.355593:0:12978:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787602530.355603:0:12978:0:(import.c:65:import_set_state_nolock()) ffff944a468a3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787602530.355636:0:12978:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff944a7c8f4d28) has no exports 00000100:00100000:3.0:1787602530.355735:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838995456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602530.355775:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602530.355810:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602530.355816:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838995328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602530.355838:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602530.355875:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838995200 00000100:00100000:3.0:1787602530.355884:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838995200 00000100:00100000:3.0:1787602530.355939:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838995584 00000100:00100000:3.0:1787602530.355943:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838995584 00000100:00100000:3.0:1787602530.355958:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838995456 00000100:00100000:3.0:1787602530.355960:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838995456 00000100:00100000:3.0:1787602530.355970:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838995328 00000100:00100000:3.0:1787602530.355972:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838995328 00000100:00100000:3.0:1787602530.355985:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787602530.355996:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+21:3312:x1874436838995200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602530.356010:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602530.356030:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41487000/0x576b7af90af468b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af468a9 expref: 21 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602530.356084:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602530.356128:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+20:3312:x1874436838995200:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602530.356136:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787602530.356161:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787602530.356167:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+19:3311:x1874436838995584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602530.360557:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602530.360601:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41486c00/0x576b7af90af4658b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af46584 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602530.360629:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602530.360750:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+18:3311:x1874436838995584:12345-0@lo:103:ldlm_bl.0 Request processed in 4581us (5623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602530.360761:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787602530.360815:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787602530.360831:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+17:3314:x1874436838995456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602530.360839:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602530.360850:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41477200/0x576b7af90af46ad9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af46ad2 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602530.360859:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602530.360893:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+16:3314:x1874436838995456:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (5116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602530.360899:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787602530.360914:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787602530.360921:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+15:3314:x1874436838995328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602530.360933:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602530.360943:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890c800/0x576b7af90af467d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af467d0 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602530.360955:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602530.360978:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5c99bea-fdac-431e-b440-876dfd3e206e+14:3314:x1874436838995328:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (5139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602530.361004:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787602530.361192:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5c99bea-fdac-431e-b440-876dfd3e206e:3312:1874436838995200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602530.361235:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c5c99bea-fdac-431e-b440-876dfd3e206e:3311:1874436838995584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602530.361260:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838995328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602530.361268:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838995456:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787602530.366128:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a46296800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787602530.366203:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944945807000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787602530.366230:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a576bc000 for lustre-MDT0000 00000020:00000080:2.0:1787602530.366239:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944945802000 for lustre-MDT0000 00000100:00100000:2.0:1787602530.366269:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838995712:0@lo:9:umount.0 00000100:00100000:2.0:1787602530.366380:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602530.366428:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838995840:0@lo:9:umount.0 00000100:00100000:2.0:1787602530.366455:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602530.366530:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838995712 00000100:00100000:2.0:1787602530.366541:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838995712 00000100:00100000:2.0:1787602530.366608:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838995840 00000100:00100000:2.0:1787602530.366612:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838995840 00000100:00100000:2.0:1787602530.366639:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787602530.366649:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874436838995712:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787602530.366687:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46728 00000100:00080000:2.0:1787602530.366697:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9449410d1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787602530.366761:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787602530.367213:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1874436838995712:12345-0@lo:9:umount.0 Request processed in 563us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602530.367223:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787602530.367243:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787602530.367252:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874436838995840:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787602530.367265:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46801 00000100:00080000:2.0:1787602530.367271:0:6694:0:(import.c:65:import_set_state_nolock()) ffff944a7c868800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787602530.367293:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787602530.367505:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1874436838995840:12345-0@lo:9:umount.0 Request processed in 254us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602530.367512:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787602530.367541:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787602530.367546:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787602530.367559:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787602530.367596:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a7c093800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787602530.367612:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787602530.367614:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787602530.367619:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838995712:0@lo:9:umount.0 00000100:00080000:2.0:1787602530.367633:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a468a3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787602530.367641:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787602530.367643:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787602530.367645:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838995840:0@lo:9:umount.0 00010000:00010000:2.0:1787602530.367681:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602530.368429:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787602530.392684:0:12978:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff944a7c8f4d28) has no exports 00000020:00000080:1.0:1787602530.462538:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af465df 00000020:00000080:1.0:1787602530.462562:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a762a5000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787602530.462588:0:12978:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787602530.462672:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a762a5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787602530.462712:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787602530.462726:0:12978:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787602530.462731:0:12978:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff944a4658cd28) has no exports 00000020:00000080:2.0:1787602530.465000:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af465d8 00000020:00000080:2.0:1787602530.465062:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a762a3800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787602530.465127:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a762a3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787602530.465187:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787602530.465201:0:12978:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787602530.465205:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a762a4000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787602530.465208:0:12978:0:(genops.c:844:class_export_destroy()) destroying export ffff944a762a4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787602530.465214:0:12978:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1787602530.465401:0:12978:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff944a7c5674e0 - data ffff944a667e1870/ffff944a6e56a000 00000020:01000000:2.0:1787602530.465570:0:12978:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff944a62367c00 - data ffff944a6643bbd0/ffff944a7c2df800 00000001:00000004:2.0:1787602530.498285:0:12978:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787602530.619635:0:12978:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787602530.619647:0:12978:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787602530.619674:0:12978:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787602530.619678:0:12978:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787602530.622286:0:7164:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787602530.622297:0:7164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787602530.622323:0:7164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787602530.628305:0:12978:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787602530.628326:0:12978:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787602530.630512:0:12978:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787602530.630523:0:12978:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787602530.638967:0:7659:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787602530.638978:0:7659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787602530.639000:0:7659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787602530.747717:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af465a7 00000020:00000080:0.0:1787602530.747735:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a7c902000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787602530.748265:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c902000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787602530.749872:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af465bc 00000020:00000080:0.0:1787602530.749887:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a7c907000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787602530.749899:0:12978:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787602530.749907:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602530.749918:0:12978:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787602530.749923:0:12978:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff944a7c8f0000) has no exports 00000004:01000000:0.0:1787602530.750521:0:12978:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787602530.750536:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af467fa 00000020:00000080:0.0:1787602530.750542:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a7c86b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787602530.750548:0:12978:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787602530.750554:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602530.750562:0:12978:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787602530.750565:0:12978:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff944945143370) has no exports 00000020:00000080:0.0:1787602530.750573:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af467f3 00000020:00000080:0.0:1787602530.750592:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a468a4800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787602530.750992:0:12978:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787602530.750999:0:12978:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787602530.751004:0:12978:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787602530.751010:0:12978:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787602530.751013:0:12978:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787602530.751084:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602530.751092:0:12978:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787602530.751100:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46713 00000020:00000080:0.0:1787602530.751106:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a46295000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787602530.751110:0:12978:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787602530.751114:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602530.751117:0:12978:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787602530.751120:0:12978:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff944a465899b8) has no exports 00000020:00000080:0.0:1787602530.751124:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af4670c 00000020:00000080:0.0:1787602530.751127:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a7c093000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787602530.751297:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c907000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787602530.751320:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c86b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787602530.751326:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a468a4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787602530.751332:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a468a3000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787602530.751338:0:36:0:(genops.c:885:class_export_put()) final put ffff944a468a2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787602530.751340:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a468a2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787602530.751345:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787602530.751425:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a46295000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787602530.751431:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c093000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787602530.751994:0:12978:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787602530.751999:0:12978:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787602530.752003:0:12978:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787602530.752009:0:12978:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787602530.752011:0:12978:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787602530.752458:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a7c093800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787602530.752537:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602530.752547:0:12978:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787602530.752552:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a7c091800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787602530.752554:0:12978:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c091800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787602530.752561:0:12978:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787602530.754788:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602530.754807:0:12978:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787602530.754813:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a576be800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787602530.754819:0:12978:0:(genops.c:844:class_export_destroy()) destroying export ffff944a576be800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787602530.754840:0:12978:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787602530.755074:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af465c3 00000020:00000080:0.0:1787602530.755084:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a7c902800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787602530.755102:0:12978:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787602530.755108:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602530.755114:0:12978:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787602530.755118:0:12978:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff944a7c8f3370) has no exports 00000020:00000080:0.0:1787602530.755147:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602530.755151:0:12978:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787602530.755155:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af465ca 00000020:00000080:0.0:1787602530.755159:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a7c900000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787602530.755613:0:12978:0:(tgt_mount.c:187:server_put_mount()) put mount ffff944a487a1000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787602530.755618:0:12978:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944a487a1000 3 00000020:01000004:0.0:1787602530.755622:0:12978:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff944a487a1000 from lustre-MDT0000 00000020:00000080:0.0:1787602530.755645:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602530.755659:0:12978:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787602530.755663:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a7c901800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787602530.755666:0:12978:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c901800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787602530.755676:0:12978:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787602530.755712:0:12978:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787602530.755716:0:12978:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787602530.755719:0:12978:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787602530.755722:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602530.755725:0:12978:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787602530.755733:0:12978:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff944a464a7000 c5c99bea-fdac-431e-b440-876dfd3e206e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787602530.755739:0:12978:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff944a469a19b8) has exports, disconnecting them 00000020:00080000:0.0:1787602530.755744:0:12978:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff944a464a7000), last request at 1787602328 00000020:00000080:0.0:1787602530.755760:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46568 00000020:00010000:0.0:1787602530.755765:0:12978:0:(genops.c:1921:obd_stale_export_put()) Put export ffff944a464a7000: total 2 00000100:00080000:0.0:1787602530.755770:0:12978:0:(import.c:65:import_set_state_nolock()) ffff944a464a2000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787602530.755790:0:12978:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff944a464a7000): rc 0 00000020:00080000:0.0:1787602530.755794:0:12978:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff944a469a19b8) has no exports 00000100:00100000:0.0:1787602530.755853:0:5827:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff944a469dc200:5827] 1 exiting: rc = 0 00000100:00100000:0.0:1787602530.755976:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff944a469dd800:5826] 0 exiting: rc = 1 00000020:00010000:1.0:1787602530.756525:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff944a464a7000: total 2 00010000:00010000:1.0:1787602530.756567:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff944a464a7000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787602530.756603:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5011c800/0x576b7af90af46acb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af46ac4 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602530.756621:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41476600/0x576b7af90af46680 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af46679 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602530.756637:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41486800/0x576b7af90af468be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af468b7 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602530.756659:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5011ca00/0x576b7af90af46abd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af46ab6 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602530.756674:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890d000/0x576b7af90af46878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af46871 expref: 5 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602530.756684:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5890dc00/0x576b7af90af4686a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af46863 expref: 4 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602530.756695:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a41476c00/0x576b7af90af46886 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af4687f expref: 3 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602530.756705:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d70a00/0x576b7af90af46894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x576b7af90af4688d expref: 2 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602530.756715:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff944a464a7000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787602530.756728:0:5821:0:(genops.c:885:class_export_put()) final put ffff944a464a7000/c5c99bea-fdac-431e-b440-876dfd3e206e 00000020:00000080:2.0:1787602530.757116:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c902800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787602530.757135:0:36:0:(genops.c:885:class_export_put()) final put ffff944a7c906000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787602530.757138:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c906000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787602530.757144:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787602530.757790:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c900000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787602530.758494:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff944a46584000:5828] 2 exiting: rc = 0 00000100:00100000:2.0:1787602530.758920:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758933:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758940:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758948:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758954:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758960:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758966:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758973:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758979:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758985:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758991:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.758998:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759006:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759013:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759020:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759026:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759032:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759405:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759414:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759421:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759427:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759433:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759439:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759445:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759452:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759458:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759464:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759470:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759476:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759481:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759510:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759516:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759522:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759528:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759534:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759540:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759547:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759553:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759558:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759564:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759570:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759576:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759581:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759587:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759593:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759600:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759606:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759611:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759617:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759623:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759628:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759633:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759638:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759644:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.759649:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1787602530.759855:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602530.759860:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602530.759863:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787602530.759926:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a464a7000/c5c99bea-fdac-431e-b440-876dfd3e206e for MGS 00000020:00000080:0.0:1787602530.759979:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a464a2000 for MGS 00000100:00100000:2.0:1787602530.760122:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.760135:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.760141:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.760148:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.760154:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.760160:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.760232:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.760238:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.760244:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787602530.761855:0:12978:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787602530.761875:0:12978:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787602530.769286:0:12978:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff944a7c5677e0 - data ffff944a667e1e58/ffff944a6e568400 00000020:01000000:2.0:1787602530.769449:0:12978:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff944a48bcd900 - data ffff944a6abf7d80/ffff944a4654fc00 00000020:00000080:2.0:1787602530.771988:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af4654c 00000020:00000080:2.0:1787602530.772008:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a489da000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787602530.772102:0:12978:0:(tgt_mount.c:187:server_put_mount()) put mount ffff944a487a1000 from MGS, refs=2 00000020:01000004:2.0:1787602530.772107:0:12978:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944a487a1000 2 00000020:01000004:2.0:1787602530.772110:0:12978:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff944a487a1000 from MGS 00000020:00000080:2.0:1787602530.772147:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787602530.772159:0:12978:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787602530.772173:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a489da800/MGS 00000020:00000080:2.0:1787602530.772177:0:12978:0:(genops.c:844:class_export_destroy()) destroying export ffff944a489da800/MGS for MGS 00000020:01000000:2.0:1787602530.772187:0:12978:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787602530.772270:0:12978:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787602530.772275:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787602530.772282:0:12978:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787602530.772290:0:12978:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff944a7be18800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787602530.772296:0:12978:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff944a4658b370) has exports, disconnecting them 00000020:00080000:2.0:1787602530.772301:0:12978:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff944a7be18800), last request at 1787602329 00000020:00000080:2.0:1787602530.772315:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46617 00000020:00080000:2.0:1787602530.772329:0:12978:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff944a7be18800): rc 0 00000020:00000080:2.0:1787602530.772334:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a7be18800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787602530.772607:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a489da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787602530.775470:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7be18800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787602530.779146:0:12978:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787602530.779158:0:12978:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787602530.779170:0:12978:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787602530.779178:0:12978:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787602530.779526:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602530.779539:0:12978:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787602530.779547:0:12978:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944a487a1000 1 00000020:00000080:0.0:1787602530.779555:0:12978:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af4653e 00000020:00000080:0.0:1787602530.779566:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a489d9800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787602530.779572:0:12978:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787602530.779579:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602530.779584:0:12978:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787602530.779588:0:12978:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff944a46588000) has no exports 00000020:00000080:1.0:1787602530.779808:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a46297000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787602530.779817:0:8:0:(genops.c:885:class_export_put()) final put ffff944a762b9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787602530.779826:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a762b9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787602530.779834:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787602530.779914:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a489d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787602530.785946:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787602530.813462:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602530.813488:0:12978:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787602530.813495:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a48c56000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787602530.813501:0:12978:0:(genops.c:844:class_export_destroy()) destroying export ffff944a48c56000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787602530.813510:0:12978:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787602530.813671:0:12978:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff944a487a0800 00000020:01000000:0.0:1787602530.813698:0:12978:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787602530.813703:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602530.813708:0:12978:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787602530.813713:0:12978:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff944a4560b370) has no exports 00000100:00100000:0.0:1787602530.813796:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff944a47caa000:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1787602530.816644:0:5835:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff944a47cab600:5835] 2 exiting: rc = 0 00000100:00100000:0.0:1787602530.825802:0:9459:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff944a7c652c00:9459] 3 exiting: rc = 0 00000100:00100000:0.0:1787602530.825977:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff944a468f7c00:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1787602530.826130:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826139:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826146:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826153:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826159:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826177:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826184:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826191:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826197:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826203:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826209:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826215:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826222:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826228:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826233:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826239:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826244:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826250:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826257:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826263:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826269:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826276:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826282:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826288:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826294:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826319:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826326:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826332:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826337:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826343:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826348:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826353:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826359:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826365:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826391:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826401:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826406:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826412:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826418:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826430:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826436:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826442:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826448:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826453:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826459:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826465:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826471:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826477:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826482:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826487:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826493:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826499:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826505:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826511:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826518:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826524:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826530:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826536:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826542:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826547:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826560:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826566:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826573:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.826580:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.832207:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff944a47caaa00:5837] 1 exiting: rc = 0 00000100:00100000:3.0:1787602530.833069:0:12533:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff944a6efe2600:12533] 2 exiting: rc = 0 00000100:00100000:2.0:1787602530.834316:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff944a507f6c00:5836] 0 exiting: rc = 1 00000100:00100000:1.0:1787602530.834513:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834526:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834533:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834541:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834547:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834553:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834560:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834566:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834571:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834578:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834584:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834591:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834598:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834604:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834609:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834615:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834621:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834627:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834632:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834638:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834644:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834650:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834656:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834662:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834668:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834673:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834679:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834685:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834691:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834697:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834703:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834724:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834729:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834735:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834741:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834748:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834754:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834760:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834766:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834774:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834780:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834787:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834793:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834798:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834803:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834808:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834815:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834820:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834825:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834831:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834837:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834844:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834850:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834856:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834862:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834868:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834874:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834880:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834887:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834892:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834898:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834903:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834909:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.834915:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.836507:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff944a5058cc00:5839] 1 exiting: rc = 0 00000100:00100000:3.0:1787602530.837402:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff944a5058d400:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1787602530.839358:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839372:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839397:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839406:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839414:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839421:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839428:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839436:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839448:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839467:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839475:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839486:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839493:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839499:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839506:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839512:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839518:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839525:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839532:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839539:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839546:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839568:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839576:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839582:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839588:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839596:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839605:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839612:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839618:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839625:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839634:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839643:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839650:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839675:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839682:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839689:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839696:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839714:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839720:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839727:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839734:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839741:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839747:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839753:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839760:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839779:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839788:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839794:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839801:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839808:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839815:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839822:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839833:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839841:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839847:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839854:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839860:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839880:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839888:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839895:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839902:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839909:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839916:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.839931:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.852767:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838996096:0@lo:400:kworker.0 00000400:00000100:1.0:1787602530.852854:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874436838996096 offset 0 length 224: 4 00000100:00100000:1.0:1787602530.854086:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff944a42e21400:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1787602530.854624:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff944a5058c200:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1787602530.854778:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854786:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854792:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854797:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854816:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854836:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854842:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854848:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854853:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854859:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854864:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854870:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854876:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854881:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854886:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854891:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854897:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854902:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854908:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854913:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854918:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854924:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854929:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854935:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854940:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854945:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854950:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854955:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854961:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854965:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854970:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854976:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854982:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854987:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854992:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.854998:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855004:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855010:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855015:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855029:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855061:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855067:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855073:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855079:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855084:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855090:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855095:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855100:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855105:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855110:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855116:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855121:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855136:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855142:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855147:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855152:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855157:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855161:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855174:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855179:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855184:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855189:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855194:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855200:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602530.855364:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838995968:0@lo:400:kworker.0 00000400:00000100:3.0:1787602530.855418:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874436838995968 offset 0 length 224: 4 00000100:00100000:3.0:1787602530.855607:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff944a5058c400:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1787602530.855607:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff944a42e1c800:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1787602530.855681:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855688:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855693:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855700:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855705:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855711:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855716:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855722:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855728:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855743:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855749:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855755:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855761:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855766:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855772:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855778:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855783:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855788:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855794:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855800:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855806:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855811:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855817:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855822:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855827:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855832:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855838:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855843:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855847:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855852:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855857:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855862:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855867:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855872:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855877:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855881:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855886:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855890:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855896:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855900:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855905:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855910:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855915:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855920:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855931:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855936:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855942:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855947:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855952:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855957:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855962:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855967:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855972:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855977:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855982:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855987:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855991:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.855996:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.856002:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.856007:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.856012:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.856017:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.856022:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.856026:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787602530.856688:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff944a42e1d400:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1787602530.857109:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff944a42e1cc00:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1787602530.859032:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859059:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859065:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859071:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859078:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859084:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859090:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859095:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859100:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859106:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859112:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859118:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859135:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859143:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859281:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859286:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859291:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859298:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859303:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859320:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859326:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859331:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859337:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859341:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859346:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859351:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859357:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859362:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859368:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859374:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859380:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859385:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859391:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859397:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859407:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859413:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859419:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859425:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859431:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859438:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859444:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859449:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859454:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859459:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859464:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859470:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859476:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859482:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859488:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859502:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859508:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859514:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859520:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859526:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859532:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859538:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859543:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859548:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859554:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859560:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859566:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859571:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859578:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.859584:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602530.860686:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff944a42e20a00:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1787602530.861529:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff944a42e21c00:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1787602530.861745:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff944a42e21200:5848] 2 exiting: rc = 0 00000100:00100000:0.0:1787602530.862461:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862471:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862477:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862483:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862500:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862508:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862514:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862521:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862527:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862534:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862540:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862546:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862553:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862559:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862565:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862572:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862578:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862585:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862591:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862597:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862603:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862608:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862614:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862620:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862628:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862633:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862640:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862646:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862666:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862673:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862680:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862698:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862704:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862710:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862716:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862723:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862729:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862738:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862745:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862751:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862758:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862764:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862770:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862776:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862783:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862790:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862797:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862803:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862809:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.862816:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863074:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863082:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863106:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863114:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863120:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863138:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863144:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863150:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863156:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863264:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863272:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863278:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863285:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602530.863301:0:12978:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787602530.872851:0:12978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602530.872870:0:12978:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787602530.872892:0:12978:0:(genops.c:885:class_export_put()) final put ffff944a46960800/MDS_uuid 00000020:00000080:0.0:1787602530.872899:0:12978:0:(genops.c:844:class_export_destroy()) destroying export ffff944a46960800/MDS_uuid for MDS 00000020:01000000:0.0:1787602530.872911:0:12978:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787602530.873132:0:12978:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787602531.806373:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602532.830650:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787602533.517514:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787602533.517526:0:6717:0:(genops.c:885:class_export_put()) final put ffff9449410d1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787602533.517601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9449410d1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787602533.517750:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9449410d1800 for lustre-OST0000 00000020:01000004:1.0:1787602533.845179:0:13128:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787602533.860522:0:13128:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787602533.860581:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602533.860599:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602533.860607:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602533.860638:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602533.866555:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602533.866574:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602533.866589:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487c00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602533.866594:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602533.866607:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602533.866615:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602533.866621:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787602533.866624:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:0.0:1787602533.866676:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602533.866683:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787602533.866752:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838996224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602533.866833:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602533.867066:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602533.867077:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602533.867078:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602533.867080:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602533.867167:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838996224 00000100:00100000:2.0:1787602533.867178:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838996224 00000100:00100000:2.0:1787602533.867238:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787602533.867249:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1874436838996224:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787602533.867393:0:5819:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787602533 with bad export cookie 6299263713857004904 00010000:00010000:1.0:1787602533.868432:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787602533.868446:0:13128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41487c00/0x576b7af90af4687f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x576b7af90af46886 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602533.868472:0:13128:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:1.0:1787602533.868479:0:13128:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787602533.868514:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787602533.868524:0:13128:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff944a7c836d80 x1874436838995968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602533.868543:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787602533.868550:0:13128:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787602533.868577:0:13128:0:(import.c:65:import_set_state_nolock()) ffff944945802800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787602533.868654:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436838995968:0@lo:400:kworker.0 00010000:00010000:0.0:1787602533.868712:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602533.869126:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874436838996352:0@lo:39:umount.0 00000400:00000100:0.0:1787602533.869232:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874436838996352 offset 0 length 224: 4 00000100:00100000:1.0:1787602533.878925:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1874436838996224:12345-0@lo:103:ldlm_bl.0 Request processed in 11594us (12010us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787602533.878944:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787602533.880563:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787602533.880572:0:3314:0:(import.c:65:import_set_state_nolock()) ffff944a46966800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787602533.880579:0:3314:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787602533.890237:0:3314:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.125@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787602533.890245:0:3314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787602533.890263:0:3314:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9449481c5c00 x1874436838996224/t0(0) o103->MGC192.168.206.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787602549 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787602533.890317:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787602533.890320:0:3314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787602533.890322:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787602533.890806:0:3314:0:(import.c:65:import_set_state_nolock()) ffff944a46966800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787602533.890813:0:3314:0:(import.c:510:import_select_connection()) MGC192.168.206.125@tcp: connect to NID 0@lo last attempt 159 00000100:00080000:3.0:1787602533.890823:0:3314:0:(import.c:624:import_select_connection()) MGC192.168.206.125@tcp: import ffff944a46966800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:3.0:1787602533.890927:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a4d3d8e00 x1874436838996480/t0(0) o250->MGC192.168.206.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602533.891000:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5c99bea-fdac-431e-b440-876dfd3e206e:3310:1874436838996480:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1787602533.891099:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874436838996480 offset 0 length 520: 4 00000100:00100000:3.0:1787602533.891488:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5c99bea-fdac-431e-b440-876dfd3e206e:3314:1874436838996224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602534.877300:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787602534.971505:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787602534.971515:0:7648:0:(genops.c:885:class_export_put()) final put ffff944a7c86c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787602534.971615:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c86c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787602534.971788:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a7c868800 for lustre-OST0001 00010000:00010000:0.0:1787602535.901508:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787602535.967394:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5c99bea-fdac-431e-b440-876dfd3e206e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787602535.967407:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c5c99bea-fdac-431e-b440-876dfd3e206e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787602535.967648:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838996608:0@lo:400:kworker.0 00000400:00000100:3.0:1787602535.967730:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874436838996608 offset 0 length 224: 4 00010000:00010000:0.0:1787602536.925244:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602537.949583:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787602538.013175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5c99bea-fdac-431e-b440-876dfd3e206e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787602538.013185:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c5c99bea-fdac-431e-b440-876dfd3e206e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787602538.013331:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602538.013351:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838996736:0@lo:400:kworker.0 00000400:00000100:3.0:1787602538.013478:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874436838996736 offset 0 length 224: 4 00010000:00010000:0.0:1787602538.973228:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602539.997245:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602541.021277:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602542.045952:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602543.069419:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602543.134538:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602533/real 1787602533] req@ffff944a4d3d8e00 x1874436838996480/t0(0) o250->MGC192.168.206.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787602543 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602543.134673:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff944a4d3d8e00 x1874436838996480/t0(0) o250->MGC192.168.206.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787602543 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602543.134685:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602533/real 1787602533] req@ffff944a7c836300 x1874436838996352/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787602543 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602543.134698:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff944a7c836300 x1874436838996352/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787602543 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787602543.134812:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a46966800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787602543.134999:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787602543.135005:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5c99bea-fdac-431e-b440-876dfd3e206e:3310:1874436838996480:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1787602543.135013:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944945802800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787602543.135031:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874436838996352:0@lo:39:umount.0 00000100:00080000:3.0:1787602543.135060:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5c99bea-fdac-431e-b440-876dfd3e206e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787602543.135067:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787602543.135071:0:8:0:(import.c:65:import_set_state_nolock()) ffff944a46966800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787602543.135180:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787602543.135186:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787602543.135192:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787602543.135232:0:8:0:(import.c:510:import_select_connection()) MGC192.168.206.125@tcp: connect to NID 0@lo last attempt 364 00000100:00080000:3.0:1787602543.135248:0:8:0:(import.c:589:import_select_connection()) MGC192.168.206.125@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787602543.135258:0:8:0:(import.c:624:import_select_connection()) MGC192.168.206.125@tcp: import ffff944a46966800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:3.0:1787602543.135299:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a4d3d9c00 x1874436838996864/t0(0) o250->MGC192.168.206.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602543.135355:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5c99bea-fdac-431e-b440-876dfd3e206e:3310:1874436838996864:0@lo:250:kworker.0 00000100:00100000:3.0:1787602543.135379:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602543.135392:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838996992:0@lo:400:kworker.0 00000400:00000100:3.0:1787602543.135440:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874436838996992 offset 0 length 224: 4 00000400:00000100:0.0:1787602543.135475:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874436838996864 offset 0 length 520: 4 00010000:00010000:1.0:1787602543.138909:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.138948:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.138957:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.138964:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.138999:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787602543.139012:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.139018:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.139023:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.139029:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.139077:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787602543.139082:0:13128:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787602543.139107:0:13128:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787602543.139112:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787602543.139118:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602543.139124:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787602543.139129:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9449451419b8) has no exports 00000020:00080000:1.0:1787602543.139164:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9449451419b8) has no exports 00010000:00010000:2.0:1787602543.139503:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602543.139517:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.139526:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41486200 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:2.0:1787602543.139529:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.139539:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602543.139547:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602543.139553:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787602543.139556:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787602543.139558:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787602543.139574:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff944a46966800 00010000:00010000:2.0:1787602543.139578:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.139585:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41486200/0x576b7af90af4688d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af46894 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.139600:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602543.139603:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.139608:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d400 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:2.0:1787602543.139611:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.139628:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602543.139635:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602543.139640:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787602543.139642:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787602543.139644:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787602543.139650:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff944a46966800 00010000:00010000:2.0:1787602543.139652:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.139659:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5011d400/0x576b7af90af46ac4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af46acb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.139667:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602543.139668:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602543.139671:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602543.139791:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787602543.142158:0:13128:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff944a47c46240 - data ffff944a6ab71a20/ffff944a6e480400 00000020:01000000:1.0:1787602543.142396:0:13128:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff944945dabba0 - data ffff944a6abf3798/ffff9449453f7000 00100000:10000000:1.0:1787602543.149914:0:13128:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787602543.180730:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af4669c 00000020:00000080:3.0:1787602543.180743:0:13128:0:(genops.c:885:class_export_put()) final put ffff9449410d2000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787602543.180758:0:13128:0:(tgt_mount.c:187:server_put_mount()) put mount ffff944a576b9000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787602543.180762:0:13128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944a576b9000 2 00000020:01000004:3.0:1787602543.180765:0:13128:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff944a576b9000 from lustre-OST0000 00000020:00000080:3.0:1787602543.180794:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787602543.180807:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787602543.180810:0:13128:0:(genops.c:885:class_export_put()) final put ffff9449410d4800/lustre-OST0000_UUID 00000020:00000080:3.0:1787602543.180814:0:13128:0:(genops.c:844:class_export_destroy()) destroying export ffff9449410d4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787602543.180827:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787602543.180880:0:13128:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787602543.180886:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787602543.180891:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787602543.180897:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787602543.180904:0:13128:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff944a46294800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787602543.180923:0:13128:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff944a469a4d28) has exports, disconnecting them 00000020:00080000:3.0:1787602543.180930:0:13128:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff944a46294800), last request at 1787602344 00000020:00000080:3.0:1787602543.180934:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af466c6 00000020:00080000:3.0:1787602543.180945:0:13128:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff944a46294800): rc 0 00000020:00000080:3.0:1787602543.180951:0:13128:0:(genops.c:885:class_export_put()) final put ffff944a46294800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787602543.181268:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9449410d2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787602543.181278:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a46294800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787602543.184230:0:13128:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787602543.184251:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787602543.184256:0:13128:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787602543.184265:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787602543.184463:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787602543.184473:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787602543.184481:0:13128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944a576b9000 1 00000020:00000080:2.0:1787602543.184488:0:13128:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46656 00000020:00000080:2.0:1787602543.184499:0:13128:0:(genops.c:885:class_export_put()) final put ffff944a576b8000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787602543.184505:0:13128:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787602543.184512:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787602543.184535:0:13128:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787602543.184540:0:13128:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff944a7c8f19b8) has no exports 00000020:00000080:1.0:1787602543.184960:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944945802800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787602543.184974:0:8:0:(genops.c:885:class_export_put()) final put ffff944a7c096800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787602543.184978:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c096800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787602543.184985:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787602543.185079:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a576b8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787602543.210519:0:13128:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787602543.210543:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787602543.210551:0:13128:0:(genops.c:885:class_export_put()) final put ffff944a48781000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787602543.210556:0:13128:0:(genops.c:844:class_export_destroy()) destroying export ffff944a48781000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787602543.210566:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787602543.210740:0:13128:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff944a576bd800 00000020:02000400:2.0:1787602543.210795:0:13128:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787602544.099357:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602545.117338:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787602545.434645:0:13283:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787602545.443432:0:13283:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787602545.443530:0:13283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.443549:0:13283:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.443557:0:13283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.443587:0:13283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.443609:0:13283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787602545.443615:0:13283:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787602545.443640:0:13283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787602545.443654:0:13283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff944a7c834e00 x1874436838996096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602545.443684:0:13283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9449481c5500 x1874436838996608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602551 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787602545.443815:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602545.443824:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.443832:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71400 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602545.443836:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.443846:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602545.443853:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602545.443859:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787602545.443862:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787602545.443864:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787602545.443888:0:5820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff944a46966800 00010000:00010000:0.0:1787602545.443893:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.443900:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af46863 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af4686a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.443913:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602545.443915:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602545.443916:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602545.443951:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436838996096:0@lo:400:kworker.0 00000100:00100000:3.0:1787602545.443979:0:13283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9449481c5880 x1874436838996736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602554 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602545.443988:0:13283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff944a4d3d8e00 x1874436838996992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602559 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602545.444003:0:13283:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1787602545.444026:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436838996992:0@lo:400:kworker.0 00000100:00100000:2.0:1787602545.444762:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838996608:0@lo:400:kworker.0 00000100:00100000:2.0:1787602545.444792:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436838996736:0@lo:400:kworker.0 00000100:00080000:3.0:1787602545.444833:0:13283:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787602545.444865:0:13283:0:(import.c:65:import_set_state_nolock()) ffff944a46291000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787602545.444962:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874436838997120:0@lo:39:umount.0 00000400:00000100:2.0:1787602545.445142:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874436838997120 offset 0 length 224: 4 00010000:00010000:0.0:1787602546.142274:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602547.165487:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602548.194128:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787602548.253204:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5c99bea-fdac-431e-b440-876dfd3e206e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787602548.253228:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c5c99bea-fdac-431e-b440-876dfd3e206e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787602549.213614:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602550.237397:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602551.261443:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602552.285368:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602553.310742:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787602553.375198:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c5c99bea-fdac-431e-b440-876dfd3e206e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787602553.375211:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c5c99bea-fdac-431e-b440-876dfd3e206e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787602554.333865:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602555.360298:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602555.677240:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602545/real 1787602545] req@ffff944a4d3d8e00 x1874436838997120/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787602555 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602555.677272:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff944a4d3d8e00 x1874436838997120/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787602555 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787602555.677288:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a46291000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787602555.677306:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874436838997120:0@lo:39:umount.0 00000100:00080000:3.0:1787602555.677418:0:13283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787602555.677422:0:13283:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787602555.677427:0:13283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787602555.678425:0:13283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602555.678440:0:13283:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602555.678447:0:13283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602555.678454:0:13283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602555.678480:0:13283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602555.678487:0:13283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602555.678493:0:13283:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602555.678499:0:13283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602555.678506:0:13283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602555.678517:0:13283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787602555.678521:0:13283:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787602555.678549:0:13283:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787602555.678553:0:13283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787602555.678557:0:13283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787602555.678562:0:13283:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787602555.678567:0:13283:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff944945140000) has no exports 00000020:00080000:3.0:1787602555.678589:0:13283:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff944945140000) has no exports 00010000:00010000:2.0:1787602555.678766:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602555.678775:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602555.678784:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487200 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:2.0:1787602555.678789:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602555.678798:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602555.678807:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602555.678813:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787602555.678815:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787602555.678824:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787602555.678836:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff944a46966800 00010000:00010000:2.0:1787602555.678840:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602555.678847:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41487200/0x576b7af90af46871 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af46878 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602555.678864:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602555.678867:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602555.678873:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5890d800 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:2.0:1787602555.678876:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602555.678883:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602555.678889:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602555.678894:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787602555.678897:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787602555.678898:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787602555.678902:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff944a46966800 00010000:00010000:2.0:1787602555.678905:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602555.678911:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5890d800/0x576b7af90af46ab6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af46abd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602555.678933:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602555.678935:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602555.678937:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602555.680349:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787602555.681085:0:13283:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff944a47c46840 - data ffff944a6abede58/ffff944a6e482c00 00000020:01000000:3.0:1787602555.681214:0:13283:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff944a4979b2a0 - data ffff944a73c1f360/ffff944a7c85d400 00100000:10000000:3.0:1787602555.690641:0:13283:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787602555.745392:0:13283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46767 00000020:00000080:2.0:1787602555.745401:0:13283:0:(genops.c:885:class_export_put()) final put ffff944a7c4bd000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787602555.745410:0:13283:0:(tgt_mount.c:187:server_put_mount()) put mount ffff944945805800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787602555.745413:0:13283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944945805800 2 00000020:01000004:2.0:1787602555.745416:0:13283:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff944945805800 from lustre-OST0001 00000020:00000080:2.0:1787602555.745441:0:13283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787602555.745449:0:13283:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787602555.745451:0:13283:0:(genops.c:885:class_export_put()) final put ffff944a468a3800/lustre-OST0001_UUID 00000020:00000080:2.0:1787602555.745454:0:13283:0:(genops.c:844:class_export_destroy()) destroying export ffff944a468a3800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787602555.745460:0:13283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787602555.745574:0:13283:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c5c99bea-fdac-431e-b440-876dfd3e206e->MGS 00010000:00010000:2.0:1787602555.745588:0:13283:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5890c000/0x576b7af90af46679 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af46680 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602555.745600:0:13283:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5890c000/0x576b7af90af46679 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af46680 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602555.745607:0:13283:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787602555.745609:0:13283:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787602555.745612:0:13283:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787602555.745624:0:13283:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff944a46966800 00010000:00010000:2.0:1787602555.745627:0:13283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5890c000/0x576b7af90af46679 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af46680 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602555.745641:0:13283:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a41476e00/0x576b7af90af468b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x576b7af90af468be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602555.745660:0:13283:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a41476e00/0x576b7af90af468b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x576b7af90af468be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602555.745665:0:13283:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787602555.745668:0:13283:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787602555.745669:0:13283:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787602555.745679:0:13283:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff944a46966800 00010000:00010000:2.0:1787602555.745682:0:13283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a41476e00/0x576b7af90af468b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x576b7af90af468be expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787602555.745697:0:13283:0:(import.c:65:import_set_state_nolock()) ffff944a46966800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787602555.745700:0:13283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787602555.745702:0:13283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787602555.745704:0:13283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787602555.745707:0:13283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787602555.745717:0:13283:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff944a4d3d9c00 x1874436838996864/t0(0) o250->MGC192.168.206.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787602558 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787602555.745786:0:13283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787602555.745789:0:13283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000020:00000080:0.0:1787602555.748222:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c4bd000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1787602555.748625:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c5c99bea-fdac-431e-b440-876dfd3e206e:3310:1874436838996864:0@lo:250:kworker.0 10000000:01000000:2.0:1787602555.752416:0:13283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787602555.752432:0:13283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af4655a 00000020:00000080:2.0:1787602555.752441:0:13283:0:(genops.c:885:class_export_put()) final put ffff944a46961000/c5c99bea-fdac-431e-b440-876dfd3e206e 00000020:01000000:2.0:1787602555.752451:0:13283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.125@tcp (flags='') 00000020:00000080:2.0:1787602555.752460:0:13283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787602555.752467:0:13283:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.125@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787602555.752470:0:13283:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff944a4560cd28) has no exports 00000020:00000080:0.0:1787602555.752528:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a46961000/c5c99bea-fdac-431e-b440-876dfd3e206e for MGC192.168.206.125@tcp 10000000:01000000:0.0:1787602555.754304:0:5830:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787602555.754533:0:13283:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.125@tcp: client import never connected 00000100:00080000:2.0:1787602555.754537:0:13283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787602555.754541:0:13283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787602555.754544:0:13283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787602555.754555:0:13283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787602555.754603:0:13283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787602555.754610:0:13283:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.125@tcp (uuid c5c99bea-fdac-431e-b440-876dfd3e206e) 00000020:01000000:2.0:1787602555.754616:0:13283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787602555.754620:0:13283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787602555.754624:0:13283:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787602555.754630:0:13283:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff944a7c906800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787602555.754636:0:13283:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff944945144d28) has exports, disconnecting them 00000020:00080000:2.0:1787602555.754640:0:13283:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff944a7c906800), last request at 1787602361 00000020:00000080:2.0:1787602555.754645:0:13283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46791 00000020:00080000:2.0:1787602555.754658:0:13283:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff944a7c906800): rc 0 00000020:00000080:2.0:1787602555.754662:0:13283:0:(genops.c:885:class_export_put()) final put ffff944a7c906800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787602555.755623:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a46966800 for MGC192.168.206.125@tcp 00000020:00000080:0.0:1787602555.755639:0:8:0:(genops.c:885:class_export_put()) final put ffff944a46965800/c5c99bea-fdac-431e-b440-876dfd3e206e 00000020:00000080:0.0:1787602555.755642:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a46965800/c5c99bea-fdac-431e-b440-876dfd3e206e for MGC192.168.206.125@tcp 00000020:01000000:0.0:1787602555.755647:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.125@tcp (c5c99bea-fdac-431e-b440-876dfd3e206e) 00000020:00000080:0.0:1787602555.755890:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c906800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787602555.792158:0:13283:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787602555.792166:0:13283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787602555.792180:0:13283:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787602555.792187:0:13283:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787602555.792242:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787602555.792354:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787602555.792417:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787602555.792526:0:7635:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff944a6e537600:7635] 2 exiting: rc = 0 00000100:00100000:3.0:1787602555.795653:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff944a488ca200:5816] 1 exiting: rc = 0 00000100:00100000:1.0:1787602555.795797:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff944a488cb800:5815] 0 exiting: rc = 1 00000020:00000080:1.0:1787602555.795835:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff944a46291000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:0.0:1787602555.795924:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.796177:0:7636:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff944a7c5dfa00:7636] 3 exiting: rc = 0 00000100:00100000:1.0:1787602555.796229:0:8454:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff944a6ee78600:8454] 4 exiting: rc = 0 00000100:00100000:1.0:1787602555.796306:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff944a488cb600:5817] 0 exiting: rc = 1 00000100:00100000:1.0:1787602555.798972:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff944a488cbc00:5819] 2 exiting: rc = 0 00000100:00100000:3.0:1787602555.800282:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff944a488caa00:5818] 1 exiting: rc = 0 00000100:00100000:1.0:1787602555.800572:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800580:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800593:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800600:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800608:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800613:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800618:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800623:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800629:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800635:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800651:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800657:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800661:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800667:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800673:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800678:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800685:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800689:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800694:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800698:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800703:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800708:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800713:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800718:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800722:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800727:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800732:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800737:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800741:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800746:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800752:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800757:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800762:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800767:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800772:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800777:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800781:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800786:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800791:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800795:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800800:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800805:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800809:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800814:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800819:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800831:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800836:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800841:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800847:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800851:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800856:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800861:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800866:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800871:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800875:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800880:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800885:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800890:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800894:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800899:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800904:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800909:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800914:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.800920:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787602555.801788:0:13283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602555.801797:0:13283:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787602555.801803:0:13283:0:(genops.c:885:class_export_put()) final put ffff944a7c4bf800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787602555.801810:0:13283:0:(genops.c:844:class_export_destroy()) destroying export ffff944a7c4bf800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787602555.801816:0:13283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787602555.801855:0:13283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944945805800 1 00000020:00000080:1.0:1787602555.801861:0:13283:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x576b7af90af46736 00000020:00000080:1.0:1787602555.801867:0:13283:0:(genops.c:885:class_export_put()) final put ffff944a48ee5000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787602555.801882:0:13283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787602555.801892:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff944a48ee5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787602555.801907:0:13283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602555.801912:0:13283:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787602555.801915:0:13283:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff944a469a3370) has no exports 00000020:00000080:1.0:1787602555.843837:0:13283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602555.843864:0:13283:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787602555.843869:0:13283:0:(genops.c:885:class_export_put()) final put ffff944945801000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787602555.843874:0:13283:0:(genops.c:844:class_export_destroy()) destroying export ffff944945801000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787602555.843885:0:13283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787602555.844097:0:13283:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff944945804000 00000020:01000000:1.0:1787602555.844119:0:13283:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787602555.844123:0:13283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602555.844127:0:13283:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787602555.844131:0:13283:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff944a469a0000) has no exports 00000020:00000080:1.0:1787602555.844151:0:13283:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602555.844156:0:13283:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787602555.844159:0:13283:0:(genops.c:885:class_export_put()) final put ffff944a576ba800/OSS_uuid 00000020:00000080:1.0:1787602555.844161:0:13283:0:(genops.c:844:class_export_destroy()) destroying export ffff944a576ba800/OSS_uuid for OSS 00000020:01000000:1.0:1787602555.844165:0:13283:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787602555.850948:0:5829:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787602555.851156:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff944a6e5f7400:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1787602555.851240:0:8475:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff944a7c652400:8475] 3 exiting: rc = 0 00000100:00100000:2.0:1787602555.851328:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff944a6e5f6800:6694] 2 exiting: rc = 0 00000100:00100000:3.0:1787602555.854501:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff944a49489200:6693] 1 exiting: rc = 0 00000100:00100000:1.0:1787602555.854848:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854858:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854865:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854871:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854876:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854882:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854887:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854892:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854896:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854902:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854907:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854912:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854916:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854923:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854928:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854933:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854939:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854944:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854949:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854968:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854982:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854987:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854993:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.854997:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855002:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855007:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855012:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855016:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855021:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855066:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855072:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855077:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855082:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855087:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855092:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855098:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855103:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855108:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855113:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855117:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855123:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855128:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855132:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855137:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855141:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855147:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855152:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855157:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855165:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855179:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855185:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855190:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855195:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855201:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855206:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855219:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855225:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855230:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855235:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855240:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855245:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855250:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855256:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602555.855261:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.859275:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff944a6e88c800:6696] 1 exiting: rc = 0 00000100:00100000:3.0:1787602555.860473:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff944a61c48a00:6695] 0 exiting: rc = 1 00000100:00100000:0.0:1787602555.861303:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861313:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861319:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861324:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861329:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861334:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861340:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861345:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861351:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861356:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861361:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861366:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861371:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861377:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861394:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861400:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861415:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861420:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861426:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861431:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861436:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861441:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861446:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861451:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861457:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861462:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861467:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861472:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861478:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861484:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861489:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861494:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861500:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861505:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861510:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861516:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861521:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861527:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861533:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861538:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861544:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861550:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861555:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861560:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861565:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861571:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861577:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861583:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861589:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861594:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861600:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861612:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861617:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861622:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861627:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861631:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861636:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861641:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861647:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861652:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861657:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861662:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861668:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.861678:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.862571:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff944a6e88d400:6697] 0 exiting: rc = 1 00000100:00100000:0.0:1787602555.862878:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff944a6e88cc00:6698] 1 exiting: rc = 0 00000100:00100000:0.0:1787602555.863022:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff944a61c49a00:6699] 2 exiting: rc = 0 00000100:00100000:0.0:1787602555.863090:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863098:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863105:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863120:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863133:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863139:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863145:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863151:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863233:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863313:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863323:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863332:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863338:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863343:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863349:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863357:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863363:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863369:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863385:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863391:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863412:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.863418:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.864006:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.864017:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.864027:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.864033:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.864065:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.864258:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.864380:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.864386:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.864392:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.864398:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865388:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865404:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865410:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865416:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865423:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865432:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865438:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865443:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865458:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865464:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865470:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865475:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865502:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865508:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865513:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865519:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865524:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865529:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865534:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865539:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865555:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865574:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865580:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865585:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865590:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865597:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865602:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865607:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865613:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865619:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865624:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.865629:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.880092:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff944a75128000:6701] 1 exiting: rc = 0 00000100:00100000:0.0:1787602555.881243:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff944a61c48600:6700] 0 exiting: rc = 1 00000100:00100000:0.0:1787602555.881321:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881328:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881338:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881344:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881349:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881355:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881360:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881365:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881371:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881376:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881381:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881387:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881392:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881397:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881403:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881409:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881414:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881419:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881424:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881429:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881434:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881440:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881471:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881476:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881482:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881487:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881493:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881498:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881503:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881508:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881513:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881519:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881524:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881529:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881535:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881540:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881545:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881551:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881556:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881562:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881567:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881574:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881639:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881645:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881651:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881656:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881661:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881667:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881677:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881683:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881688:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881694:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881699:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881705:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881710:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881716:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881721:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881734:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881739:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881745:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881750:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881756:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881762:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.881774:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602555.884825:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff944a750f7800:6702] 0 exiting: rc = 1 00000100:00100000:3.0:1787602555.884919:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff944a47968600:6703] 1 exiting: rc = 0 00000100:00100000:0.0:1787602555.885107:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885128:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885139:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885146:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885152:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885179:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885185:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885192:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885198:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885204:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885223:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885231:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885247:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885254:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885260:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885267:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885273:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885278:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885284:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885290:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885296:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885302:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885322:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885329:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885335:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885341:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885346:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885352:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885370:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885375:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885380:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885386:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885391:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885397:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885417:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885424:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885432:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885438:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885445:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885452:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885458:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885464:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885470:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885476:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885482:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885489:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885509:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885516:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885521:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885526:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885532:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885538:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885544:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885550:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885556:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885562:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885569:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885574:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885594:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885602:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885608:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885614:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885623:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602555.885635:0:13283:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787602555.904319:0:13283:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787602573.022361:0:13900:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787602581.162409:0:14360:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787602581.162414:0:14360:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787602581.162522:0:14360:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff944946355000 00000020:01000004:2.0:1787602581.162536:0:14360:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787602581.162544:0:14360:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787602581.162558:0:14360:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff944a456099b8) 00000020:00000080:2.0:1787602581.162570:0:14360:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787602581.176749:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787602581.178627:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787602581.178944:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 640: rc = 0 00100000:10000000:3.0:1787602581.179230:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787602581.179297:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 640: rc = 0 00100000:10000000:3.0:1787602581.179398:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 640: rc = 0 00100000:10000000:3.0:1787602581.179493:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 640: rc = 0 00100000:10000000:3.0:1787602581.179586:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 640: rc = 0 00100000:10000000:3.0:1787602581.179671:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 640: rc = 0 00100000:10000000:3.0:1787602581.180262:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 642: rc = 0 00100000:10000000:3.0:1787602581.181236:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 134: rc = 0 00100000:10000000:3.0:1787602581.181327:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 134: rc = 0 00100000:10000000:3.0:1787602581.181667:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 789: rc = 0 00100000:10000000:3.0:1787602581.181982:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 789: rc = 0 00100000:10000000:3.0:1787602581.182323:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 789: rc = 0 00100000:10000000:3.0:1787602581.182570:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 789: rc = 0 00100000:10000000:3.0:1787602581.182812:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 789: rc = 0 00100000:10000000:3.0:1787602581.183150:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 789: rc = 0 00100000:10000000:3.0:1787602581.183380:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 789: rc = 0 00100000:10000000:3.0:1787602581.183593:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 789: rc = 0 00100000:10000000:3.0:1787602581.183839:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 789: rc = 0 00100000:10000000:3.0:1787602581.184158:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 789: rc = 0 00100000:10000000:3.0:1787602581.184393:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 789: rc = 0 00100000:10000000:3.0:1787602581.184629:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 789: rc = 0 00100000:10000000:3.0:1787602581.185022:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 601: rc = 0 00100000:10000000:3.0:1787602581.185387:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 601: rc = 0 00100000:10000000:3.0:1787602581.185641:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 601: rc = 0 00100000:10000000:3.0:1787602581.185891:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 601: rc = 0 00100000:10000000:3.0:1787602581.186176:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 601: rc = 0 00100000:10000000:3.0:1787602581.186434:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 601: rc = 0 00100000:10000000:3.0:1787602581.186687:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 601: rc = 0 00100000:10000000:3.0:1787602581.186939:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 601: rc = 0 00100000:10000000:3.0:1787602581.187279:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 601: rc = 0 00100000:10000000:3.0:1787602581.187740:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 601: rc = 0 00100000:10000000:3.0:1787602581.187983:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 601: rc = 0 00100000:10000000:3.0:1787602581.188299:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 601: rc = 0 00100000:10000000:3.0:1787602581.188534:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 601: rc = 0 00100000:10000000:3.0:1787602581.188780:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 601: rc = 0 00100000:10000000:3.0:1787602581.189011:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 601: rc = 0 00100000:10000000:3.0:1787602581.189363:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 601: rc = 0 00100000:10000000:3.0:1787602581.189599:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 601: rc = 0 00100000:10000000:3.0:1787602581.189856:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 601: rc = 0 00100000:10000000:3.0:1787602581.190188:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 601: rc = 0 00100000:10000000:3.0:1787602581.190422:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 601: rc = 0 00100000:10000000:3.0:1787602581.190660:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 601: rc = 0 00100000:10000000:3.0:1787602581.190916:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 601: rc = 0 00100000:10000000:3.0:1787602581.191258:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 601: rc = 0 00100000:10000000:3.0:1787602581.191501:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 601: rc = 0 00100000:10000000:3.0:1787602581.191740:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 601: rc = 0 00100000:10000000:3.0:1787602581.192171:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 601: rc = 0 00100000:10000000:3.0:1787602581.192413:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 601: rc = 0 00100000:10000000:3.0:1787602581.192651:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 601: rc = 0 00100000:10000000:3.0:1787602581.192891:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 601: rc = 0 00100000:10000000:3.0:1787602581.193229:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 601: rc = 0 00100000:10000000:3.0:1787602581.193470:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 601: rc = 0 00100000:10000000:3.0:1787602581.193713:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 601: rc = 0 00100000:10000000:3.0:1787602581.194475:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 139: rc = 0 00100000:10000000:3.0:1787602581.194963:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787602581.195206:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 786: rc = 0 00100000:10000000:3.0:1787602581.195379:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787602581.195444:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 786: rc = 0 00100000:10000000:3.0:1787602581.195622:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787602581.195682:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 786: rc = 0 00100000:10000000:3.0:1787602581.196060:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787602581.196136:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 135: rc = 0 00100000:10000000:3.0:1787602581.196333:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787602581.196399:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 135: rc = 0 00100000:10000000:3.0:1787602581.196579:0:14360:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787602581.196641:0:14360:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 135: rc = 0 00000020:00000080:3.0:1787602581.196905:0:14360:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787602581.196913:0:14360:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787602581.196923:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af4785b 00000020:01000004:3.0:1787602581.196931:0:14360:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787602581.196936:0:14360:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787602581.196941:0:14360:0:(tgt_mount.c:101:server_register_mount()) register mount ffff944946355000 from MGS 00000020:01000004:3.0:1787602581.196944:0:14360:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787602581.196954:0:14360:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9449451419b8) 00000020:00000080:3.0:1787602581.196964:0:14360:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787602581.197016:0:14360:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944946355000 from MGS, refs=2 00080000:01000000:3.0:1787602581.197020:0:14360:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787602581.197024:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af47869 00000100:00100000:3.0:1787602581.197218:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787602581.197345:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787602581.197351:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787602581.197739:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787602581.197746:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787602581.198512:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602581.198655:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787602581.198660:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787602581.199177:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787602581.199183:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787602581.199455:0:14360:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787602581.199462:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787602581.199974:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602581.199977:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602581.199979:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602581.204719:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602581.204725:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602581.204728:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602581.210241:0:14360:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787602581.214183:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787602581.225333:0:14360:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787602581.225350:0:14360:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787602581.225353:0:14360:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787602581.232535:0:14369:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787602581.235673:0:14360:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787602581.235869:0:14360:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787602581.236396:0:14360:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787602581.236832:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602581.236985:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787602581.237071:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787602581.237544:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787602581.237550:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787602581.237973:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787602581.237979:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1787602581.238748:0:14374:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787602581.238977:0:14360:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787602581.239099:0:14360:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.125@tcp' 00000020:01000004:1.0:1787602581.239101:0:14360:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787602581.239133:0:14360:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.125@tcp (typ=mgc) 00000020:00000080:1.0:1787602581.239146:0:14360:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.125@tcp (ffff944a469a0000) 00000020:00000080:1.0:1787602581.239160:0:14360:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787602581.239228:0:14360:0:(ldlm_lib.c:102:import_set_conn()) imp ffff944a6e932800@MGC192.168.206.125@tcp: add connection 192.168.206.125@tcp at head 00010000:00010000:1.0:1787602581.239365:0:14360:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.125@tcp-0 is initialized 00000040:01000000:1.0:1787602581.239377:0:14360:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.125@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787602581.240443:0:14375:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787602581.240570:0:14360:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.125@tcp (uuid 0c3bd976-3721-4ec4-bd04-79d86542b9eb) 00000020:00000080:2.0:1787602581.240593:0:14360:0:(genops.c:1385:class_connect()) connect: client 0c3bd976-3721-4ec4-bd04-79d86542b9eb, cookie 0x576b7af90af47877 00000100:00080000:2.0:1787602581.240605:0:14360:0:(import.c:510:import_select_connection()) MGC192.168.206.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787602581.240612:0:14360:0:(import.c:624:import_select_connection()) MGC192.168.206.125@tcp: import ffff944a6e932800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:2.0:1787602581.240642:0:14360:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a7c2d2a00 x1874436838997248/t0(0) o250->MGC192.168.206.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787602581.240666:0:14360:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0c3bd976-3721-4ec4-bd04-79d86542b9eb->MGS 00000020:01000004:2.0:1787602581.240684:0:14360:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787602581.240687:0:14360:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:1.0:1787602581.240694:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3310:1874436838997248:0@lo:250:mount.lustre.0 00000020:00000080:2.0:1787602581.240697:0:14360:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff944a45608000) 00000020:00000080:2.0:1787602581.240708:0:14360:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787602581.240768:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602581.240852:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838997248 00000100:00100000:1.0:1787602581.240860:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838997248 00000100:00100000:1.0:1787602581.240888:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602581.240896:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7cb1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874436838997248:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787602581.240917:0:14371:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0c3bd976-3721-4ec4-bd04-79d86542b9eb@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:1.0:1787602581.240937:0:14371:0:(genops.c:1385:class_connect()) connect: client 0c3bd976-3721-4ec4-bd04-79d86542b9eb, cookie 0x576b7af90af47885 00000100:00080000:1.0:1787602581.241087:0:14371:0:(import.c:65:import_set_state_nolock()) ffff944a6e936000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602581.241137:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7cb1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+5:3310:x1874436838997248:12345-0@lo:250:mount.lustre.0 Request processed in 241us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602581.241145:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602581.241180:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787602581.241187:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.125@tcp: connect to target with instance 0 00000100:00080000:1.0:1787602581.241194:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787602581.241197:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787602581.241201:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a6e932800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787602581.241203:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787602581.241209:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787602581.241214:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3310:1874436838997248:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787602581.246920:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602581.247163:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787602581.247171:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787602581.247858:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787602581.247866:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787602581.248523:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787602581.248530:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787602581.249256:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602581.249427:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787602581.249432:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787602581.249975:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787602581.249982:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787602581.285865:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602581.286119:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787602581.286127:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787602581.288034:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787602581.288101:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787602581.289422:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602581.289756:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787602581.289762:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787602581.290339:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787602581.290346:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787602581.291958:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602581.292304:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787602581.292311:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787602581.294628:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787602581.294640:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787602581.295729:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602581.295924:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787602581.295930:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787602581.296677:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787602581.296685:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787602581.317231:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602581.317429:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787602581.317436:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787602581.318777:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787602581.318788:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787602581.322010:0:14360:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787602581.322105:0:14360:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787602581.323401:0:14360:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787602581.324072:0:14360:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787602581.324080:0:14360:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787602581.324689:0:14360:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787602581.324729:0:14360:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.125@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787602581.324737:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787602581.324739:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602581.324740:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602581.324741:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602581.324742:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602581.324743:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602581.324744:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602581.324746:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602581.324811:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602581.324813:0:14360:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787602581.324816:0:14360:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787602581.324819:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787602581.324820:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602581.324821:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602581.324822:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602581.324823:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602581.324824:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602581.324825:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602581.324825:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602581.324827:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602581.324828:0:14360:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787602581.324864:0:14360:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787602581.324884:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838997376:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787602581.324957:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602581.325162:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838997376 00000100:00100000:1.0:1787602581.325170:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838997376 00000100:00100000:1.0:1787602581.325223:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602581.325234:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+5:14360:x1874436838997376:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787602581.325279:0:14373:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787602581.325282:0:14373:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787602581.325285:0:14373:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:3.0:1787602581.325518:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b900 going to sleep for 11 seconds 10000000:01000000:1.0:1787602581.325681:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787602581.326457:0:14373:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787602581.329022:0:14395:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787602581.329072:0:14395:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787602581.329076:0:14395:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787602581.329114:0:14395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787602581.329409:0:14373:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787602581.329421:0:14373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787602581.340512:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+5:14360:x1874436838997376:12345-0@lo:253:mount.lustre.0 Request processed in 15273us (15547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602581.340531:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787602581.340708:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838997376:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787602581.340724:0:14360:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787602581.340728:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787602581.340729:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602581.340731:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602581.340732:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602581.340733:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602581.340734:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602581.340735:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602581.340737:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602581.340738:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602581.340740:0:14360:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787602581.340775:0:14360:0:(tgt_mount.c:101:server_register_mount()) register mount ffff944946355000 from lustre-MDT0000 10000000:01000000:3.0:1787602581.340803:0:14360:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787602581.340806:0:14360:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787602581.340810:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff944a469a0000 10000000:01000000:3.0:1787602581.340815:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787602581.340822:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff944a469a0000 from 1 10000000:01000000:3.0:1787602581.340825:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787602581.340859:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.340870:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.340879:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602581.340911:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838997504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787602581.341122:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602581.341149:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602581.341434:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838997504 00000100:00100000:0.0:1787602581.341441:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838997504 00000100:00100000:0.0:1787602581.341483:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602581.341493:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+5:14360:x1874436838997504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602581.341504:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602581.341517:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a7c459200/0x576b7af90af47893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4788c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.341538:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a7c459200/0x576b7af90af47893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4788c expref: 6 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.341548:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a7c459200/0x576b7af90af47893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4788c expref: 6 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.341557:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459200, rc 0) 00000100:00100000:0.0:1787602581.341675:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+6:14360:x1874436838997504:12345-0@lo:101:mount.lustre.0 Request processed in 183us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602581.341681:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602581.341760:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838997504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602581.341776:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47893 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.341784:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47893 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602581.341833:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838997632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602581.341859:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602581.341972:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602581.342592:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838997632 00000100:00100000:1.0:1787602581.342599:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838997632 00000100:00100000:1.0:1787602581.342673:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602581.342682:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+6:14360:x1874436838997632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602581.342928:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+6:14360:x1874436838997632:12345-0@lo:501:mount.lustre.0 Request processed in 247us (1067us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602581.342936:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602581.343058:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838997632:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787602581.343089:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787602581.343106:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47893 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.343114:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47893 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602581.343123:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff944946355000 10000000:01000000:3.0:1787602581.343128:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787602581.343132:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff944946355000 10000000:01000000:3.0:1787602581.343135:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787602581.343137:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff944946355000 from 1 10000000:01000000:3.0:1787602581.343140:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787602581.343172:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70e00/0x576b7af90af4789a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.343180:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a47d70e00/0x576b7af90af4789a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.343187:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a47d70e00/0x576b7af90af4789a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602581.343201:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838997760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787602581.343231:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602581.343250:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602581.343489:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838997760 00000100:00100000:1.0:1787602581.343494:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838997760 00000100:00100000:1.0:1787602581.343513:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602581.343533:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+6:14360:x1874436838997760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602581.343542:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602581.343556:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011c000/0x576b7af90af478a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af4789a expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.343588:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011c000/0x576b7af90af478a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af4789a expref: 7 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.343597:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011c000/0x576b7af90af478a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af4789a expref: 7 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.343605:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c000, rc 0) 00000100:00100000:1.0:1787602581.343632:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+7:14360:x1874436838997760:12345-0@lo:101:mount.lustre.0 Request processed in 113us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602581.343638:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787602581.343752:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838997760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602581.343764:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a47d70e00/0x576b7af90af4789a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af478a1 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.343782:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a47d70e00/0x576b7af90af4789a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af478a1 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602581.343794:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787602581.343808:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70e00/0x576b7af90af4789a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af478a1 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.343815:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d70e00/0x576b7af90af4789a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af478a1 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602581.343820:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787602581.343824:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787602581.343829:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff944946355000 10000000:01000000:3.0:1787602581.343831:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787602581.343834:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787602581.343836:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787602581.343850:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70c00/0x576b7af90af478a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.343857:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a47d70c00/0x576b7af90af478a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.343864:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a47d70c00/0x576b7af90af478a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602581.343876:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838997888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787602581.343900:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602581.343917:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602581.343974:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838997888 00000100:00100000:1.0:1787602581.343987:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838997888 00000100:00100000:1.0:1787602581.344006:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602581.344011:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+7:14360:x1874436838997888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602581.344017:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602581.344025:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011d400/0x576b7af90af478af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af478a8 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.344074:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011d400/0x576b7af90af478af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af478a8 expref: 8 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.344082:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011d400/0x576b7af90af478af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af478a8 expref: 8 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.344088:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d400, rc 0) 00000100:00100000:1.0:1787602581.344112:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+8:14360:x1874436838997888:12345-0@lo:101:mount.lustre.0 Request processed in 100us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602581.344117:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602581.344335:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838997888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602581.344346:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a47d70c00/0x576b7af90af478a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af478af expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.344353:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a47d70c00/0x576b7af90af478a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af478af expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602581.344394:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838998016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602581.344419:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602581.344443:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602581.344625:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838998016 00000100:00100000:1.0:1787602581.344629:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838998016 00000100:00100000:1.0:1787602581.344647:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602581.344653:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+8:14360:x1874436838998016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602581.345024:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+9:14360:x1874436838998016:12345-0@lo:501:mount.lustre.0 Request processed in 370us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602581.345065:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602581.346310:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838998016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602581.346358:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838998144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602581.346413:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602581.346443:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602581.346516:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838998144 00000100:00100000:2.0:1787602581.346522:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838998144 00000100:00100000:3.0:1787602581.346794:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787602581.346803:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+9:14360:x1874436838998144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602581.347762:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+9:14360:x1874436838998144:12345-0@lo:503:mount.lustre.0 Request processed in 956us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602581.347772:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787602581.347850:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838998144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787602581.352199:0:14396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14396:1874436838998272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602581.352291:0:14396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602581.352569:0:14396:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c1ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602581.352687:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838998272 00000100:00100000:0.0:1787602581.352694:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838998272 00000100:00100000:0.0:1787602581.352732:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787602581.352741:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+9:14396:x1874436838998272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602581.353076:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+9:14396:x1874436838998272:12345-0@lo:502:llog_process_th.0 Request processed in 336us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602581.353084:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787602581.353124:0:14396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14396:1874436838998272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602581.353206:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602581.353216:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602581.353218:0:14396:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787602581.353223:0:14396:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787602581.353226:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787602581.353239:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff944a4560cd28) 00000020:00000080:2.0:1787602581.353256:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787602581.353261:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787602581.353392:0:14396:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787602581.353399:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af478bd 00000020:00000080:2.0:1787602581.353705:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787602581.353716:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602581.353719:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602581.353721:0:14396:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787602581.353724:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602581.353727:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602581.353729:0:14396:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787602581.353732:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787602581.353740:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff944a4560b370) 00000020:00000080:2.0:1787602581.353749:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787602581.353753:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787602581.353755:0:14396:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787602581.353758:0:14396:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787602581.353763:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787602581.353809:0:14396:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944946355000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787602581.353829:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff944a46283370) 00000020:00000080:2.0:1787602581.353838:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787602581.353878:0:14396:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787602581.354143:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x576b7af90af478d2 00000020:00000080:2.0:1787602581.354406:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787602581.354412:0:14396:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787602581.354418:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x576b7af90af478d9 00080000:01000000:2.0:1787602581.354423:0:14396:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787602581.354427:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af478e0 00010000:00010000:2.0:1787602581.475560:0:14396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787602581.477295:0:14396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787602581.477476:0:14396:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787602581.478595:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff944a462819b8) 00000020:00000080:2.0:1787602581.478615:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787602581.478705:0:14396:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787602581.478712:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af478ee 00000020:00000080:1.0:1787602581.479774:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787602581.484389:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x576b7af90af478f5 00000020:00000080:2.0:1787602581.485061:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787602581.485072:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602581.485084:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602581.485086:0:14396:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787602581.485090:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787602581.485093:0:14396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787602581.485094:0:14396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787602581.485096:0:14396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787602581.485097:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787602581.485100:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602581.485101:0:14396:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787602581.485104:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602581.485108:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602581.485109:0:14396:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787602581.485113:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787602581.485150:0:14396:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787602581.485163:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602581.485166:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602581.485167:0:14396:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787602581.485170:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787602581.485173:0:14396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787602581.485176:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602581.485178:0:14396:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787602581.485181:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787602581.485186:0:14396:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.125@tcp to nid 0x20000c0a8ce7d (192.168.206.125@tcp) 00000020:01000000:2.0:1787602581.485211:0:14396:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787602581.485214:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787602581.485228:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff944a46280000) 00000020:00000080:2.0:1787602581.485240:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787602581.485245:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787602581.485291:0:14396:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787602581.485438:0:14396:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787602581.485446:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af47903 00010000:00080000:2.0:1787602581.485475:0:14396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff944a7c0c8800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.125@tcp at head 00010000:00010000:2.0:1787602581.485698:0:14396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787602581.486505:0:14396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787602581.486564:0:14396:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787602581.490955:0:14396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602581.491160:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787602581.491237:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787602581.491930:0:14399:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787602581.491935:0:14399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787602581.495964:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787602581.495978:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787602581.496014:0:14396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787602581.496060:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x576b7af90af4790a 00000100:00080000:1.0:1787602581.496069:0:14396:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787602581.496075:0:14396:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff944a7c0c8800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:1.0:1787602581.496108:0:14396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a7c837800 x1874436838998400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787602581.496143:0:14396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787602581.496183:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838998400:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1787602581.496196:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602581.496214:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602581.496216:0:14396:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787602581.496219:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787602581.496221:0:14396:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1787602581.496223:0:14396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787602581.496224:0:14396:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787602581.496225:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787602581.496227:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602581.496229:0:14396:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787602581.496231:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787602581.496234:0:14396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787602581.496237:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000400:00000100:0.0:1787602581.496238:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874436838998400 offset 0 length 520: 4 00000020:00000080:1.0:1787602581.496245:0:14396:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787602581.496249:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787602581.496252:0:14396:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.125@tcp to nid 0x20000c0a8ce7d (192.168.206.125@tcp) 00000020:01000000:1.0:1787602581.496271:0:14396:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787602581.496273:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787602581.496284:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff944a469a3370) 00000020:00000080:1.0:1787602581.496295:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787602581.496300:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787602581.496365:0:14396:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787602581.496371:0:14396:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787602581.496376:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x576b7af90af47918 00010000:00080000:1.0:1787602581.496409:0:14396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff944a47d9c800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.125@tcp at head 00010000:00010000:1.0:1787602581.497544:0:14396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787602581.499625:0:14396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787602581.499652:0:14396:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787602581.500167:0:14396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602581.500233:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787602581.500291:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787602581.500920:0:14402:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787602581.500925:0:14402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787602581.501758:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787602581.501769:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787602581.501798:0:14396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787602581.501816:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x576b7af90af4791f 00000100:00080000:1.0:1787602581.501826:0:14396:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787602581.501831:0:14396:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff944a47d9c800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:1.0:1787602581.501864:0:14396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a7c834e00 x1874436838998528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787602581.501892:0:14396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787602581.501950:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602581.501959:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602581.501961:0:14396:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787602581.501964:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602581.501968:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602581.501969:0:14396:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787602581.501972:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787602581.501974:0:14396:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787602581.501976:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602581.501978:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602581.501979:0:14396:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787602581.501981:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602581.501983:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602581.501984:0:14396:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787602581.501987:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787602581.502017:0:14396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c836a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14396:1874436838998656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602581.502121:0:14396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602581.502315:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838998656 00000100:00100000:1.0:1787602581.502322:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838998656 00000100:00100000:1.0:1787602581.502357:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602581.502365:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+9:14396:x1874436838998656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602581.502568:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+9:14396:x1874436838998656:12345-0@lo:502:llog_process_th.0 Request processed in 202us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602581.502576:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787602581.502620:0:14396:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a42dbb840 going to sleep for 11 seconds 00000100:00100000:0.0:1787602581.502642:0:14396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c836a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14396:1874436838998656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602581.502668:0:14396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602581.502673:0:14396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602581.502674:0:14396:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787602581.502678:0:14396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787602581.503070:0:14360:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787602581.503088:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787602581.503105:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70c00/0x576b7af90af478a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af478af expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.503115:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d70c00/0x576b7af90af478a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af478af expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602581.503134:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff944946355000 from 1 10000000:01000000:1.0:1787602581.503136:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787602581.503174:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.503182:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.503191:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602581.503216:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838998784:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787602581.503247:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602581.503266:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a42dbb840 going to sleep for 11 seconds 00000100:00100000:2.0:1787602581.503991:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838998528:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787602581.504074:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874436838998528 offset 0 length 520: 4 00000100:00100000:0.0:1787602581.504092:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838998784 00000100:00100000:0.0:1787602581.504099:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838998784 00000100:00100000:0.0:1787602581.504133:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787602581.504141:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+9:14360:x1874436838998784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602581.504154:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602581.504167:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a7c458200/0x576b7af90af4792d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47926 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.504188:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a7c458200/0x576b7af90af4792d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47926 expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.504209:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a7c458200/0x576b7af90af4792d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47926 expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.504218:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458200, rc 0) 00000100:00100000:0.0:1787602581.504261:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+10:14360:x1874436838998784:12345-0@lo:101:mount.lustre.0 Request processed in 121us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602581.504268:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787602581.504439:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838998784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787602581.504453:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.504462:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602581.505797:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838998912:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787602581.505868:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602581.505956:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c1b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787602581.506647:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838998912 00000100:00100000:1.0:1787602581.506656:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838998912 00000100:00100000:1.0:1787602581.506762:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787602581.506772:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+10:14360:x1874436838998912:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787602581.506791:0:14373:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787602581.506797:0:14373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787602581.506893:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+10:14360:x1874436838998912:12345-0@lo:256:mount.lustre.0 Request processed in 111us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602581.506901:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787602581.507020:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838998912:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787602581.509083:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787602581.509109:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.511576:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602581.511654:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944946355000 from 1 10000000:01000000:2.0:1787602581.511658:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787602581.511702:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.511735:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.511748:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602581.511773:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787602581.511845:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602581.512196:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47c1b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787602581.512752:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838999040 00000100:00100000:1.0:1787602581.512761:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838999040 00000100:00100000:1.0:1787602581.512859:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787602581.512869:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+10:14360:x1874436838999040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602581.512909:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602581.512925:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011c800/0x576b7af90af4793b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47934 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.512949:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011c800/0x576b7af90af4793b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47934 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.512959:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011c800/0x576b7af90af4793b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47934 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.512968:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c800, rc 0) 00000100:00100000:1.0:1787602581.513066:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14360:x1874436838999040:12345-0@lo:101:mount.lustre.0 Request processed in 199us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602581.513073:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602581.513362:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602581.513379:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.513387:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602581.513448:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602581.513480:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602581.515601:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49ed80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602581.515699:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838999168 00000100:00100000:2.0:1787602581.515709:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838999168 00000100:00100000:2.0:1787602581.515753:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787602581.515763:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14360:x1874436838999168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602581.522380:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14360:x1874436838999168:12345-0@lo:501:mount.lustre.0 Request processed in 6611us (8892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602581.522393:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787602581.523406:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602581.523465:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602581.523530:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602581.523567:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602581.523626:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838999296 00000100:00100000:1.0:1787602581.523633:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838999296 00000100:00100000:1.0:1787602581.523676:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787602581.523685:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14360:x1874436838999296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602581.523861:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14360:x1874436838999296:12345-0@lo:503:mount.lustre.0 Request processed in 176us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602581.523867:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602581.524983:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602581.526220:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14404:1874436838999424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602581.526302:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602581.526380:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838999424 00000100:00100000:2.0:1787602581.526387:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838999424 00000100:00100000:3.0:1787602581.526394:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602581.526450:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787602581.526460:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14404:x1874436838999424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602581.526701:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14404:x1874436838999424:12345-0@lo:502:llog_process_th.0 Request processed in 243us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602581.526709:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787602581.526838:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14404:1874436838999424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787602581.526864:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602581.526872:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602581.526874:0:14404:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787602581.526881:0:14404:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944946355000 00000020:00000080:3.0:1787602581.526883:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787602581.526891:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602581.526894:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602581.526895:0:14404:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787602581.526897:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602581.526900:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602581.526901:0:14404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787602581.526904:0:14404:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944946355000 00000020:00000080:3.0:1787602581.526906:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787602581.527176:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602581.527182:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602581.527184:0:14404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787602581.527186:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602581.527188:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602581.527190:0:14404:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787602581.527193:0:14404:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff944946355000 00000020:00000080:3.0:1787602581.527195:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787602581.536792:0:14404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14404:1874436838999552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602581.536877:0:14404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602581.536922:0:14404:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602581.538707:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838999552 00000100:00100000:2.0:1787602581.538720:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838999552 00000100:00100000:2.0:1787602581.541222:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787602581.541249:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14404:x1874436838999552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602581.541472:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14404:x1874436838999552:12345-0@lo:502:llog_process_th.0 Request processed in 230us (4595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602581.541480:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787602581.541831:0:14404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14404:1874436838999552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602581.541862:0:14404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602581.541869:0:14404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602581.541871:0:14404:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787602581.541875:0:14404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787602581.545360:0:14360:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787602581.545392:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787602581.545410:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.545422:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602581.545463:0:14360:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787602581.545466:0:14360:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff944946355000 10000000:01000000:2.0:1787602581.545470:0:14360:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff944946355000 10000000:01000000:2.0:1787602581.545473:0:14360:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787602581.545479:0:14360:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944946355000 from 1 10000000:01000000:2.0:1787602581.545495:0:14360:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787602581.545529:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a40030600/0x576b7af90af47942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.545537:0:14360:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a40030600/0x576b7af90af47942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.545549:0:14360:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a40030600/0x576b7af90af47942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602581.545571:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787602581.545634:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602581.545683:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838999680 00000100:00100000:2.0:1787602581.545690:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838999680 00000100:00100000:2.0:1787602581.545724:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787602581.545732:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14360:x1874436838999680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787602581.545744:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602581.545757:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a40030c00/0x576b7af90af47949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47942 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.545779:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a40030c00/0x576b7af90af47949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47942 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.545790:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a40030c00/0x576b7af90af47949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47942 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.545799:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a40030c00, rc 0) 00000100:00100000:2.0:1787602581.545828:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14360:x1874436838999680:12345-0@lo:101:mount.lustre.0 Request processed in 97us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602581.545835:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787602581.545873:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602581.546637:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787602581.546655:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a40030600/0x576b7af90af47942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47949 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.546664:0:14360:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a40030600/0x576b7af90af47942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47949 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602581.546716:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602581.546751:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602581.546788:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602581.546964:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838999808 00000100:00100000:3.0:1787602581.546974:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838999808 00000100:00100000:3.0:1787602581.547015:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787602581.547024:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14360:x1874436838999808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602581.547283:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14360:x1874436838999808:12345-0@lo:501:mount.lustre.0 Request processed in 260us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602581.547290:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787602581.547296:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602581.547322:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787602581.547358:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602581.547377:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436838999936 00000100:00100000:2.0:1787602581.547380:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602581.547381:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436838999936 00000100:00100000:0.0:1787602581.547402:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787602581.547409:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14360:x1874436838999936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602581.547548:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14360:x1874436838999936:12345-0@lo:503:mount.lustre.0 Request processed in 139us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602581.547554:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787602581.547657:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436838999936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602581.547939:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14409:1874436839000064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602581.547973:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602581.547985:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787602581.548024:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839000064 00000100:00100000:0.0:1787602581.548055:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839000064 00000100:00100000:0.0:1787602581.548079:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787602581.548086:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e566c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14409:x1874436839000064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602581.548247:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e566c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14409:x1874436839000064:12345-0@lo:502:llog_process_th.0 Request processed in 162us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602581.548258:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787602581.548901:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14409:1874436839000064:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787602581.548962:0:14409:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787602581.548976:0:14409:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff944a46284d28) 00000020:00000080:2.0:1787602581.548993:0:14409:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787602581.549154:0:14409:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944946355000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787602581.549158:0:14409:0:(tgt_mount.c:187:server_put_mount()) put mount ffff944946355000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787602581.549161:0:14409:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944946355000 4 00010000:00080000:2.0:1787602581.549186:0:14409:0:(ldlm_lib.c:102:import_set_conn()) imp ffff944a45026800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.125@tcp at head 00010000:00010000:2.0:1787602581.552190:0:14409:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787602581.552426:0:14409:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787602581.552459:0:14409:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787602581.552471:0:14409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x576b7af90af47957 00000100:00080000:2.0:1787602581.552481:0:14409:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787602581.552486:0:14409:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff944a45026800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:2.0:1787602581.552518:0:14409:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a7c2d0a80 x1874436839000192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787602581.552546:0:14409:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787602581.552688:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874436839000192:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787602581.552765:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602581.552932:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839000192 00000100:00100000:2.0:1787602581.552939:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839000192 00000100:00100000:2.0:1787602581.552972:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602581.552979:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874436839000192:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787602581.553074:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874436839000192:12345-0@lo:38:llog_process_th.0 Request processed in 93us (308us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787602581.553081:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602581.553410:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787602581.553418:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a45026800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787602581.553422:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787602581.553426:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874436839000192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787602581.556087:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14409:1874436839000320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602581.556159:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602581.556191:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46bfc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787602581.556302:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839000320 00000100:00100000:3.0:1787602581.556309:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839000320 00000100:00100000:3.0:1787602581.556355:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787602581.556364:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14409:x1874436839000320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602581.556672:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14409:x1874436839000320:12345-0@lo:502:llog_process_th.0 Request processed in 308us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602581.556679:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787602581.556891:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14409:1874436839000320:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787602581.556919:0:14409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787602581.557132:0:14360:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787602581.557150:0:14360:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787602581.557168:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a40030600/0x576b7af90af47942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47949 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602581.557185:0:14360:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a40030600/0x576b7af90af47942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47949 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787602581.557225:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787602581.557227:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602581.557228:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602581.557229:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602581.557231:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602581.557232:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602581.557234:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602581.557235:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602581.557237:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602581.557238:0:14360:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787602581.557241:0:14360:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787602581.557244:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787602581.557245:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602581.557246:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602581.557248:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602581.557249:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602581.557250:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602581.557251:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602581.557252:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602581.557253:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602581.557254:0:14360:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787602581.557268:0:14360:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787602581.557280:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436839000448:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787602581.557314:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602581.557337:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787602581.557351:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839000448 00000100:00100000:3.0:1787602581.557355:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839000448 00000100:00100000:3.0:1787602581.557378:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787602581.557385:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14360:x1874436839000448:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787602581.557415:0:14373:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787602581.557430:0:14373:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787602581.619439:0:14373:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787602581.619454:0:14373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787602581.619476:0:14394:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787602581.619480:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787602581.619504:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.619523:0:14394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a7c458200/0x576b7af90af4792d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47926 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.619545:0:14394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.619585:0:14394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a7c458200/0x576b7af90af4792d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af47926 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.619600:0:14394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a7c458200/0x576b7af90af4792d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af47926 expref: 12 pid: 14371 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602581.619617:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874436839000576:0@lo:104: 00000100:00100000:1.0:1787602581.619686:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602581.619736:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602581.620531:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839000576 00000100:00100000:0.0:1787602581.620540:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839000576 00000100:00100000:0.0:1787602581.620590:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602581.620599:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:14394:x1874436839000576:12345-0@lo:104: 00010000:00010000:0.0:1787602581.620612:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.620677:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602581.620684:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:14394:x1874436839000576:12345-0@lo:104: Request processed in 86us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602581.620690:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602581.620734:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874436839000576:0@lo:104: 00010000:00010000:0.0:1787602581.620757:0:14394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.620773:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602581.620779:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.620787:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ce00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602581.620791:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.620800:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602581.620807:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602581.620821:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602581.620854:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.620860:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602581.620881:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.621278:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5011ce00/0x576b7af90af47926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4792d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602581.621747:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3314:1874436839000704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602581.621797:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602581.621868:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602581.621870:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602581.621872:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602581.622091:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839000704 00000100:00100000:2.0:1787602581.622098:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839000704 00010000:00010000:2.0:1787602581.622125:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a7c458200/0x576b7af90af4792d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47926 expref: 13 pid: 14371 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602581.622157:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602581.622165:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+13:3314:x1874436839000704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602581.622176:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602581.622182:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a7c458200/0x576b7af90af4792d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47926 expref: 13 pid: 14371 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622194:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a7c458200/0x576b7af90af4792d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af47926 expref: 13 pid: 14371 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622208:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a7c458200/0x576b7af90af4792d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af47926 expref: 13 pid: 14371 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622224:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622248:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787602581.622263:0:14363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002783819s 00010000:00010000:2.0:1787602581.622268:0:14363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622275:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622282:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622289:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622295:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011ca00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602581.622298:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622306:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622321:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602581.622331:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602581.622367:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:3314:x1874436839000704:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602581.622374:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787602581.622459:0:14394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.622468:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602581.622475:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5011ca00/0x576b7af90af4795e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602581.622509:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3314:1874436839000704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602581.633442:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14360:x1874436839000448:12345-0@lo:253:mount.lustre.0 Request processed in 76047us (76118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602581.633456:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787602581.633553:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14360:1874436839000448:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787602581.633568:0:14360:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787602581.633572:0:14360:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787602581.633573:0:14360:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602581.633575:0:14360:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602581.633576:0:14360:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602581.633577:0:14360:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602581.633579:0:14360:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602581.633580:0:14360:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602581.633582:0:14360:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602581.633584:0:14360:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602581.633585:0:14360:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787602581.633600:0:14360:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787602581.643461:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602581.643627:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787602581.644289:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602581.644448:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787602581.644709:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602581.644858:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602581.646112:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602581.646276:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602581.646540:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602581.646769:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602581.647329:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602581.647473:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787602581.669152:0:14360:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787602581.669957:0:14360:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787602581.670202:0:14416:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787602581.670218:0:14416:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787602581.670337:0:14417:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787602581.670420:0:14417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787602581.675632:0:14360:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787602581.675782:0:14360:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602581.676234:0:14417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787602581.676298:0:14417:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787602581.676302:0:14417:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:2.0:1787602581.677361:0:14360:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787602581.677398:0:14360:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787602581.677615:0:14360:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602581.678815:0:14360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787602581.679581:0:14360:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787602581.679619:0:14360:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787602581.680355:0:14360:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1787602581.681255:0:14360:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787602581.686706:0:14360:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787602581.716116:0:14360:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787602581.716152:0:14360:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbadb41953988 00100000:10000000:2.0:1787602581.716161:0:14360:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787602581.717080:0:14360:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787602581.717095:0:14360:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787602581.717110:0:14360:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787602581.717130:0:14360:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787602582.240381:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787602582.621338:0:14411:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602582.621348:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602582.621708:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787602582.621715:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1787602582.883014:0:14375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787602582.883033:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff944946355000 from 6 10000000:01000000:2.0:1787602582.883048:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787602582.883088:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602582.883110:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602582.883122:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602582.883254:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839000832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787602582.883323:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602582.883375:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6bf55900 going to sleep for 11 seconds 00000100:00100000:3.0:1787602582.883457:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839000832 00000100:00100000:3.0:1787602582.883464:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839000832 00000100:00100000:3.0:1787602582.883516:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787602582.883526:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14375:x1874436839000832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602582.883538:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602582.883552:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d71e00/0x576b7af90af4796c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47965 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602582.883573:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71e00/0x576b7af90af4796c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47965 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602582.883581:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d71e00/0x576b7af90af4796c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47965 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602582.883596:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71e00, rc 0) 00000100:00100000:3.0:1787602582.883645:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14375:x1874436839000832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602582.883652:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787602582.883911:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839000832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602582.883925:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602582.883935:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602582.883981:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c837480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839000960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787602582.884011:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602582.884095:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d329000 going to sleep for 11 seconds 00000100:00100000:2.0:1787602582.884131:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839000960 00000100:00100000:2.0:1787602582.884135:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839000960 00000100:00100000:2.0:1787602582.884280:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787602582.884286:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14375:x1874436839000960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787602582.884300:0:14373:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787602582.884313:0:14373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787602582.884317:0:14373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787602582.884482:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14375:x1874436839000960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 195us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602582.884490:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787602582.884544:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c837480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839000960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787602582.884589:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787602582.884596:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602582.884604:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602583.262225:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787602583.645632:0:14411:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602583.645642:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602583.647784:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787602583.647856:0:14411:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602583.648502:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1787602584.286075:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602585.310153:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787602585.572302:0:14659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787602586.333542:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787602586.653306:0:13619:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787602586.653313:0:13619:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787602586.653316:0:13619:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787602586.653319:0:13619:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787602586.653321:0:13619:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787602586.653324:0:13619:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787602586.653328:0:13619:0:(import.c:65:import_set_state_nolock()) ffff944a45026800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787602586.653340:0:13619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff944a45026800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:1.0:1787602586.653372:0:13619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a7c837100 x1874436839001216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787602586.653442:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602586.653461:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839001088:0@lo:400:kworker.0 00000100:00100000:1.0:1787602586.653521:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602586.653581:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874436839001216:0@lo:38:kworker.0 00000100:00100000:1.0:1787602586.653612:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602586.654133:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839001088 00000100:00100000:3.0:1787602586.654142:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839001088 00000100:00100000:3.0:1787602586.654182:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787602586.654191:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:3312:x1874436839001088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602586.654246:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:3312:x1874436839001088:12345-0@lo:400:kworker.0 Request processed in 56us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602586.654254:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787602586.654297:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839001216 00000100:00100000:3.0:1787602586.654301:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839001216 00000100:00100000:3.0:1787602586.654320:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787602586.654325:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874436839001216:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787602586.654363:0:14380:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:3.0:1787602586.654394:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x576b7af90af47973 00000004:00100000:3.0:1787602586.654407:0:14380:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787602586.656107:0:14380:0:(import.c:65:import_set_state_nolock()) ffff944a762b8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602586.656180:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874436839001216:12345-0@lo:38:kworker.0 Request processed in 1852us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602586.656189:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787602586.656266:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839001088:0@lo:400:kworker.0 00010000:00080000:1.0:1787602586.656315:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff944a7c837100 x1874436839001216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787602586.656330:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787602586.656336:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787602586.656341:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787602586.656343:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a45026800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787602586.656348:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874436839001216:0@lo:38:kworker.0 00010000:00010000:2.0:1787602587.359253:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602588.393303:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787602588.396379:0:14811:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff78050710 20000000:00000080:0.0:1787602588.396394:0:14811:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff944a6eea7800 uarg=0000000000000000 20000000:01000000:0.0:1787602588.396423:0:14811:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787602588.396430:0:14811:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787602588.396435:0:14811:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787602588.401511:0:14812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787602588.401710:0:14811:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787602588.407498:0:14811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787602588.407703:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602588.407721:0:14811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a5011c800/0x576b7af90af4793b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47934 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602588.407729:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602588.407770:0:14811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a5011c800/0x576b7af90af4793b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af47934 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602588.407786:0:14811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a5011c800/0x576b7af90af4793b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af47934 expref: 11 pid: 14372 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602588.407805:0:14811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14811:1874436839001344:0@lo:104: 00000100:00100000:1.0:1787602588.407952:0:14811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602588.408102:0:14811:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a61d04600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602588.408333:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839001344 00000100:00100000:0.0:1787602588.408341:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839001344 00000100:00100000:0.0:1787602588.408389:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602588.408400:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:14811:x1874436839001344:12345-0@lo:104: 00010000:00010000:0.0:1787602588.408413:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408529:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602588.408536:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c835880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:14811:x1874436839001344:12345-0@lo:104: Request processed in 138us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602588.408543:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787602588.408564:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602588.408576:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408584:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40030a00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602588.408587:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408596:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602588.408604:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602588.408610:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787602588.408641:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408648:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602588.408667:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408674:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af47934 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4793b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408690:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602588.408692:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602588.408694:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602588.408712:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839001472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602588.408742:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602588.408779:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839001472 00000100:00100000:0.0:1787602588.408790:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839001472 00010000:00010000:0.0:1787602588.408807:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a5011c800/0x576b7af90af4793b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47934 expref: 12 pid: 14372 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602588.408830:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602588.408837:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:3312:x1874436839001472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787602588.408897:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602588.408903:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a5011c800/0x576b7af90af4793b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47934 expref: 12 pid: 14372 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408913:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a5011c800/0x576b7af90af4793b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af47934 expref: 12 pid: 14372 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408929:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408937:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408950:0:14363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408957:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408964:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408971:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.408976:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602588.408986:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.409005:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.409014:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.409055:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602588.409087:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:3312:x1874436839001472:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602588.409094:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602588.409125:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839001472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602588.411266:0:14811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5011c800/0x576b7af90af4793b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af47934 expref: 11 pid: 14372 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602588.411300:0:14811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14811:1874436839001344:0@lo:104: 00010000:00010000:3.0:1787602588.411321:0:14811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.411330:0:14811:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.411336:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.411342:0:14811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5011d800/0x576b7af90af4797a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602589.406129:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787602589.469134:0:14375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602589.469141:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944946355000 from 10 10000000:01000000:0.0:1787602589.469146:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602589.469198:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602589.469215:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602589.469227:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602589.469253:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839001600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602589.469337:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602589.469387:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a469079c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602589.470113:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839001600 00000100:00100000:2.0:1787602589.470121:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839001600 00000100:00100000:2.0:1787602589.470166:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787602589.470175:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+11:14375:x1874436839001600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602589.470200:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602589.470215:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a40031000/0x576b7af90af47988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47981 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602589.470242:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a40031000/0x576b7af90af47988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47981 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602589.470254:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a40031000/0x576b7af90af47988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47981 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602589.470265:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a40031000, rc 0) 00000100:00100000:2.0:1787602589.470324:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14375:x1874436839001600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602589.470332:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787602589.470370:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839001600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602589.470387:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602589.470396:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602589.470454:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839001728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602589.470484:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602589.470519:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a469079c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602589.470571:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839001728 00000100:00100000:2.0:1787602589.470576:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839001728 00000100:00100000:2.0:1787602589.470607:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787602589.470613:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14375:x1874436839001728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602589.470902:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14375:x1874436839001728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602589.470909:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787602589.471020:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839001728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602589.471076:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c837100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839001856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602589.471115:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602589.471133:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a49ed8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787602589.474230:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839001856 00000100:00100000:2.0:1787602589.474245:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839001856 00000100:00100000:2.0:1787602589.474334:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787602589.474344:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14375:x1874436839001856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602589.474596:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:14375:x1874436839001856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (3479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602589.474614:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787602589.474652:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c837100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839001856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787602589.476295:0:14868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787602589.485276:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787602589.485307:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602589.485318:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602589.485329:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602590.430255:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602591.453418:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787602591.773377:0:13619:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787602591.773383:0:13619:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787602591.773386:0:13619:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787602591.773389:0:13619:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787602591.773464:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436839002112:0@lo:400:kworker.0 00000100:00100000:1.0:1787602591.773548:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602591.773612:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602591.773619:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3314:1874436839001984:0@lo:400:kworker.0 00000100:00100000:1.0:1787602591.773651:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602591.773698:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839001984 00000100:00100000:1.0:1787602591.773705:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839001984 00000100:00100000:1.0:1787602591.773749:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787602591.773757:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:3314:x1874436839001984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602591.773806:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:3314:x1874436839001984:12345-0@lo:400:kworker.0 Request processed in 48us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602591.773813:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787602591.773869:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3314:1874436839001984:0@lo:400:kworker.0 00000100:00100000:2.0:1787602591.774136:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839002112 00000100:00100000:2.0:1787602591.774141:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839002112 00000100:00100000:2.0:1787602591.774174:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602591.774182:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436839002112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602591.774222:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436839002112:12345-0@lo:400:kworker.0 Request processed in 41us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602591.774228:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787602591.774309:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff944a7c2d1c00 x1874436839002112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602591.774321:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436839002112:0@lo:400:kworker.0 00000100:00100000:0.0:1787602591.780834:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602581/real 1787602581] req@ffff944a7c834e00 x1874436838998528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602591 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602591.780863:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff944a7c834e00 x1874436838998528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602591 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602591.780873:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602581/real 1787602581] req@ffff944a7c837800 x1874436838998400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602591 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602591.780884:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff944a7c837800 x1874436838998400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602591 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787602591.780908:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a47d9c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787602591.780923:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787602591.780927:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838998528:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787602591.780932:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a7c0c8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787602591.780937:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787602591.780940:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436838998400:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787602591.781145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787602591.781150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787602591.781152:0:36:0:(import.c:65:import_set_state_nolock()) ffff944a7c0c8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787602591.781156:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:0.0:1787602591.781161:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787602591.781166:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff944a7c0c8800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:0.0:1787602591.781195:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9449481c7800 x1874436839002240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787602591.781212:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787602591.781215:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787602591.781216:0:36:0:(import.c:65:import_set_state_nolock()) ffff944a47d9c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787602591.781219:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:0.0:1787602591.781221:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787602591.781224:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff944a47d9c800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:0.0:1787602591.781235:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9449481c5880 x1874436839002368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602591.781256:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436839002240:0@lo:8:kworker.0 00000400:00000100:0.0:1787602591.781310:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874436839002240 offset 0 length 520: 4 00000100:00100000:0.0:1787602591.781341:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436839002368:0@lo:8:kworker.0 00000400:00000100:0.0:1787602591.781360:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874436839002368 offset 0 length 520: 4 00010000:00010000:3.0:1787602592.478297:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787602592.971772:0:15061:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787602592.971775:0:15061:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787602592.971902:0:15061:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff944a7c906800 00000020:01000004:1.0:1787602592.971922:0:15061:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787602592.972006:0:15061:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787602592.972020:0:15061:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff944a469a4d28) 00000020:00000080:1.0:1787602592.972113:0:15061:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787602593.003099:0:15061:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787602593.004506:0:15061:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787602593.005925:0:15061:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787602593.008916:0:15061:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787602593.009419:0:15061:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787602593.009910:0:15061:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 426: rc = 0 00100000:10000000:3.0:1787602593.010098:0:15061:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 426: rc = 0 00100000:10000000:3.0:1787602593.010431:0:15061:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 426: rc = 0 00100000:10000000:3.0:1787602593.011389:0:15061:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 217: rc = 0 00100000:10000000:3.0:1787602593.011764:0:15061:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 217: rc = 0 00100000:10000000:3.0:1787602593.012764:0:15061:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 217: rc = 0 00100000:10000000:3.0:1787602593.016104:0:15061:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 217: rc = 0 00100000:10000000:2.0:1787602593.017649:0:15061:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 217: rc = 0 00100000:10000000:2.0:1787602593.018018:0:15061:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 217: rc = 0 00000020:00000080:2.0:1787602593.022005:0:15061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787602593.022017:0:15061:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787602593.022029:0:15061:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x576b7af90af47996 00000020:01000004:2.0:1787602593.022063:0:15061:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787602593.022084:0:15061:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787602593.022088:0:15061:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787602593.022094:0:15061:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787602593.022098:0:15061:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787602593.022120:0:15061:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff944a4a394d28) 00000020:00000080:2.0:1787602593.022132:0:15061:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787602593.032438:0:15061:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602593.034146:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787602593.034164:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787602593.036373:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787602593.036386:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787602593.037640:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787602593.037651:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787602593.041136:0:15061:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602593.041533:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787602593.041540:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787602593.048309:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787602593.048325:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787602593.093741:0:15061:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602593.094494:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787602593.094501:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787602593.096541:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787602593.096622:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787602593.097901:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787602593.097913:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787602593.100956:0:15061:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602593.101449:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787602593.101456:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787602593.107734:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787602593.107749:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787602593.186156:0:15061:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602593.188825:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787602593.188850:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787602593.194405:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787602593.194421:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787602593.198188:0:15061:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787602593.198225:0:15061:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787602593.198232:0:15061:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787602593.233731:0:15061:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.125@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787602593.233771:0:15061:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.125@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787602593.233776:0:15061:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787602593.233777:0:15061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787602593.233779:0:15061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602593.233780:0:15061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602593.233781:0:15061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602593.233783:0:15061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602593.233784:0:15061:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602593.233786:0:15061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602593.233788:0:15061:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787602593.233792:0:15061:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787602593.233794:0:15061:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787602593.233796:0:15061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787602593.233797:0:15061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602593.233798:0:15061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602593.233799:0:15061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602593.233800:0:15061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602593.233801:0:15061:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602593.233802:0:15061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602593.233804:0:15061:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787602593.233913:0:15061:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787602593.233932:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839002496:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787602593.234013:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602593.234157:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1787602593.234593:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839002496 00000100:00100000:2.0:1787602593.234601:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839002496 00000100:00100000:2.0:1787602593.234692:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787602593.234703:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:15061:x1874436839002496:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787602593.234735:0:14372:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787602593.234738:0:14372:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787602593.234742:0:14372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787602593.255408:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:15061:x1874436839002496:12345-0@lo:253:mount.lustre.0 Request processed in 20697us (21385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602593.255422:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787602593.256337:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839002496:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787602593.256354:0:15061:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787602593.256358:0:15061:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787602593.256359:0:15061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787602593.256360:0:15061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602593.256362:0:15061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602593.256379:0:15061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602593.256380:0:15061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602593.256382:0:15061:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602593.256384:0:15061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602593.256385:0:15061:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787602593.256407:0:15061:0:(tgt_mount.c:101:server_register_mount()) register mount ffff944a7c906800 from lustre-OST0000 10000000:01000000:1.0:1787602593.256432:0:15061:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787602593.256435:0:15061:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787602593.256442:0:15061:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff944a469a0000 local copy 00010000:00010000:1.0:1787602593.256452:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47893 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602593.257999:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839002624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602593.258087:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602593.259951:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602593.260956:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839002624 00000100:00100000:3.0:1787602593.260978:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839002624 00000100:00100000:3.0:1787602593.261106:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787602593.261117:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:15061:x1874436839002624:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602593.261418:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:15061:x1874436839002624:12345-0@lo:501:mount.lustre.0 Request processed in 302us (3329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602593.261426:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787602593.261522:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839002624:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787602593.261545:0:15061:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787602593.261721:0:15061:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787602593.261730:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47893 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602593.261740:0:15061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47893 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602593.261765:0:15061:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff944a7c906800 10000000:01000000:2.0:1787602593.261770:0:15061:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787602593.261774:0:15061:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff944a469a0000 10000000:01000000:2.0:1787602593.261776:0:15061:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787602593.261779:0:15061:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff944a469a0000 from 1 10000000:01000000:2.0:1787602593.261781:0:15061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787602593.261813:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a40030e00/0x576b7af90af479a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602593.261820:0:15061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a40030e00/0x576b7af90af479a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602593.261836:0:15061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a40030e00/0x576b7af90af479a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602593.261854:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839002752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787602593.261892:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602593.261929:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d329600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602593.262446:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839002752 00000100:00100000:0.0:1787602593.262453:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839002752 00000100:00100000:0.0:1787602593.262500:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787602593.262509:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+12:15061:x1874436839002752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602593.262528:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602593.262544:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a7c458800/0x576b7af90af479ab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af479a4 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602593.262566:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a7c458800/0x576b7af90af479ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af479a4 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602593.262576:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a7c458800/0x576b7af90af479ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af479a4 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602593.262584:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458800, rc 0) 00000100:00100000:0.0:1787602593.262631:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+13:15061:x1874436839002752:12345-0@lo:101:mount.lustre.0 Request processed in 123us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602593.262638:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787602593.262775:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839002752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787602593.262789:0:15061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a40030e00/0x576b7af90af479a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479ab expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602593.262798:0:15061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a40030e00/0x576b7af90af479a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af479ab expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602593.262813:0:15061:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787602593.262828:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a40030e00/0x576b7af90af479a4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479ab expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602593.262835:0:15061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a40030e00/0x576b7af90af479a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479ab expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602593.262842:0:15061:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787602593.262847:0:15061:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787602593.262852:0:15061:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787602593.262854:0:15061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787602593.262870:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af479b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602593.262877:0:15061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af479b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602593.262891:0:15061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af479b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602593.262905:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839002880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787602593.262934:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602593.262977:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d329600 going to sleep for 11 seconds 00000100:00100000:3.0:1787602593.263505:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839002880 00000100:00100000:3.0:1787602593.263511:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839002880 00000100:00100000:3.0:1787602593.263551:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787602593.263559:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+13:15061:x1874436839002880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602593.263569:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602593.263580:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70800/0x576b7af90af479b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af479b2 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.263597:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70800/0x576b7af90af479b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af479b2 expref: 14 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.263606:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70800/0x576b7af90af479b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af479b2 expref: 14 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.263614:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70800, rc 0) 00000100:00100000:3.0:1787602593.266109:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+14:15061:x1874436839002880:12345-0@lo:101:mount.lustre.0 Request processed in 2540us (3162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602593.266122:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787602593.266925:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839002880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787602593.266947:0:15061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af479b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479b9 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602593.266959:0:15061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af479b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af479b9 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787602593.268888:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787602593.269938:0:15061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787602593.270272:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787602593.270426:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787602593.270462:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787602593.270526:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787602593.270567:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787602593.270602:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787602593.270670:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787602593.270677:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787602593.270764:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602593.270835:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.270879:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602593.271004:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839003008 00000100:00100000:1.0:1787602593.271011:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839003008 00000100:00100000:1.0:1787602593.271073:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787602593.271083:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+14:15061:x1874436839003008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602593.271412:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+14:15061:x1874436839003008:12345-0@lo:501:mount.lustre.0 Request processed in 329us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602593.271420:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787602593.274315:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602593.274376:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003136:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602593.274455:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.274505:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602593.276759:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839003136 00000100:00100000:1.0:1787602593.276773:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839003136 00000100:00100000:1.0:1787602593.276843:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787602593.276853:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+14:15061:x1874436839003136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602593.277330:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+14:15061:x1874436839003136:12345-0@lo:503:mount.lustre.0 Request processed in 478us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602593.277339:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787602593.277578:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003136:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787602593.278153:0:15061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787602593.278295:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787602593.278351:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.278387:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602593.278873:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839003264 00000100:00100000:2.0:1787602593.278880:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839003264 00000100:00100000:2.0:1787602593.278916:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787602593.278924:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+14:15061:x1874436839003264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787602593.279189:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+14:15061:x1874436839003264:12345-0@lo:502:mount.lustre.0 Request processed in 264us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602593.279196:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787602593.279521:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787602593.279740:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787602593.279789:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787602593.279817:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787602593.279870:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787602593.279912:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787602593.279939:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787602593.279995:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787602593.280027:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787602593.280093:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787602593.280136:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787602593.280165:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787602593.280553:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787602593.280591:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787602593.280646:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.280718:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602593.280766:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839003392 00000100:00100000:2.0:1787602593.280773:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839003392 00000100:00100000:2.0:1787602593.280818:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787602593.280827:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+14:15061:x1874436839003392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787602593.281137:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+14:15061:x1874436839003392:12345-0@lo:502:mount.lustre.0 Request processed in 311us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602593.281153:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787602593.281591:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787602593.281678:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787602593.281689:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787602593.283676:0:15075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787602593.283687:0:15075:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787602593.283694:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602593.283696:0:15075:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787602593.283702:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787602593.283718:0:15075:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff944a46588000) 00000020:00000080:0.0:1787602593.283740:0:15075:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787602593.283747:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787602593.283805:0:15075:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944a7c906800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787602593.283812:0:15075:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787602593.283819:0:15075:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x576b7af90af479c7 00010000:00010000:0.0:1787602593.289879:0:15075:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787602593.294000:0:15075:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787602593.302559:0:15075:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787602593.314132:0:15075:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787602593.314143:0:15075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602593.314149:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602593.314151:0:15075:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787602593.314155:0:15075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787602593.314157:0:15075:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787602593.314159:0:15075:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787602593.314161:0:15075:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787602593.314162:0:15075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787602593.314164:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602593.314166:0:15075:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787602593.314168:0:15075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602593.314171:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602593.314172:0:15075:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787602593.314181:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787602593.314183:0:15075:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787602593.314185:0:15075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602593.314188:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602593.314189:0:15075:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787602593.314191:0:15075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602593.314194:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602593.314195:0:15075:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787602593.314198:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787602593.314257:0:15075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602593.314261:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602593.314262:0:15075:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787602593.314265:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787602593.315956:0:15061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787602593.316009:0:15061:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787602593.316033:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af479b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479b9 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602593.316067:0:15061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a40030a00/0x576b7af90af479b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479b9 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602593.316076:0:15061:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a7c906800 from 1 10000000:01000000:1.0:1787602593.316079:0:15061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787602593.316116:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602593.316125:0:15061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602593.316137:0:15061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602593.316160:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787602593.316226:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602593.316263:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602593.316288:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839003520 00000100:00100000:1.0:1787602593.316295:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839003520 00000100:00100000:1.0:1787602593.316335:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787602593.316344:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+14:15061:x1874436839003520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602593.316355:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602593.316366:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011de00/0x576b7af90af479d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af479ce expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602593.316403:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011de00/0x576b7af90af479d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af479ce expref: 15 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602593.316424:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011de00/0x576b7af90af479d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af479ce expref: 15 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602593.316433:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011de00, rc 0) 00000100:00100000:1.0:1787602593.316474:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839003520:12345-0@lo:101:mount.lustre.0 Request processed in 130us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602593.316481:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787602593.316528:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602593.316542:0:15061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602593.316551:0:15061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602593.317063:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787602593.321459:0:15061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602593.321736:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787602593.321785:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787602593.321849:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787602593.321857:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787602593.321952:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602593.322021:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602593.322088:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602593.322322:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839003648 00000100:00100000:2.0:1787602593.322330:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839003648 00000100:00100000:2.0:1787602593.322378:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787602593.322390:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839003648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602593.322620:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839003648:12345-0@lo:501:mount.lustre.0 Request processed in 231us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602593.322628:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787602593.322838:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602593.322873:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602593.322914:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.322943:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602593.322994:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839003776 00000100:00100000:1.0:1787602593.323000:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839003776 00000100:00100000:1.0:1787602593.323023:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787602593.323030:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839003776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602593.323213:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839003776:12345-0@lo:503:mount.lustre.0 Request processed in 183us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602593.323221:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787602593.323375:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003776:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787602593.323909:0:15061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787602593.323987:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787602593.324030:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.324090:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a43728f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602593.324393:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839003904 00000100:00100000:1.0:1787602593.324400:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839003904 00000100:00100000:1.0:1787602593.324441:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787602593.324448:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839003904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602593.324614:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839003904:12345-0@lo:502:mount.lustre.0 Request processed in 166us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602593.324622:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787602593.324671:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839003904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787602593.324909:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787602593.324952:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787602593.325010:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787602593.325068:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787602593.325101:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787602593.325139:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787602593.325171:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787602593.325206:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787602593.325235:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c836a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602593.328412:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602593.328487:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602593.330500:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839004032 00000100:00100000:3.0:1787602593.330514:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839004032 00000100:00100000:3.0:1787602593.330577:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787602593.330587:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839004032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787602593.330854:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839004032:12345-0@lo:502:mount.lustre.0 Request processed in 268us (5577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602593.330862:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787602593.330943:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c836a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787602593.331118:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787602593.331133:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787602593.342772:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602593.342785:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602593.342788:0:15079:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787602593.342796:0:15079:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944a7c906800 00000020:00000080:2.0:1787602593.342799:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787602593.342806:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602593.342808:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602593.342809:0:15079:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787602593.342811:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602593.342813:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602593.342814:0:15079:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787602593.342817:0:15079:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944a7c906800 00000020:00000080:2.0:1787602593.342819:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787602593.342922:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602593.342926:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602593.342928:0:15079:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787602593.342931:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602593.342933:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602593.342935:0:15079:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787602593.342938:0:15079:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff944a7c906800 00000020:00000080:2.0:1787602593.342940:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787602593.346255:0:15079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602593.346268:0:15079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602593.346270:0:15079:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787602593.346275:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787602593.350117:0:15061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787602593.350180:0:15061:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787602593.350214:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.350227:0:15061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602593.350291:0:15061:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787602593.350294:0:15061:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff944a7c906800 10000000:01000000:3.0:1787602593.350297:0:15061:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff944a7c906800 10000000:01000000:3.0:1787602593.350301:0:15061:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787602593.350306:0:15061:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944a7c906800 from 1 10000000:01000000:3.0:1787602593.350308:0:15061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787602593.350350:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af479dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.350359:0:15061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af479dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.350369:0:15061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af479dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602593.350392:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787602593.350449:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.350488:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602593.350514:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839004160 00000100:00100000:3.0:1787602593.350527:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839004160 00000100:00100000:3.0:1787602593.350566:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787602593.350574:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839004160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602593.350586:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602593.350597:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70a00/0x576b7af90af479e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af479dc expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.350617:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70a00/0x576b7af90af479e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af479dc expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.350627:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70a00/0x576b7af90af479e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af479dc expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.350636:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70a00, rc 0) 00000100:00100000:3.0:1787602593.350671:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15061:x1874436839004160:12345-0@lo:101:mount.lustre.0 Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602593.350678:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787602593.350727:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602593.350739:0:15061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af479dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479e3 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.350748:0:15061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af479dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af479e3 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787602593.351345:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787602593.351678:0:15061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787602593.352264:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787602593.354559:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787602593.354598:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787602593.354675:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787602593.354707:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787602593.354744:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787602593.354790:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787602593.354820:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787602593.354864:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787602593.354900:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787602593.354932:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787602593.354990:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787602593.355025:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787602593.355079:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787602593.355122:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787602593.355154:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787602593.355185:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787602593.355227:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787602593.359617:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787602593.359747:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787602593.359811:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787602593.359840:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787602593.359889:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787602593.359930:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787602593.359957:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787602593.359999:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787602593.360054:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787602593.360086:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787602593.360155:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787602593.360162:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787602593.360260:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602593.360333:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.360366:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a43039600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602593.360628:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839004288 00000100:00100000:0.0:1787602593.360635:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839004288 00000100:00100000:0.0:1787602593.360679:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787602593.360687:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15061:x1874436839004288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602593.360940:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15061:x1874436839004288:12345-0@lo:501:mount.lustre.0 Request processed in 252us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602593.360947:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787602593.367001:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602593.367194:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602593.367262:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.367308:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a43039600 going to sleep for 11 seconds 00000100:00100000:3.0:1787602593.367330:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839004416 00000100:00100000:3.0:1787602593.367337:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839004416 00000100:00100000:3.0:1787602593.367379:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787602593.367390:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15061:x1874436839004416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602593.367569:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15061:x1874436839004416:12345-0@lo:503:mount.lustre.0 Request processed in 181us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602593.367577:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787602593.367625:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787602593.368146:0:15061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787602593.368210:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787602593.368252:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.368286:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a43039600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602593.368841:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839004544 00000100:00100000:0.0:1787602593.368849:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839004544 00000100:00100000:0.0:1787602593.368889:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787602593.368898:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15061:x1874436839004544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602593.369141:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15061:x1874436839004544:12345-0@lo:502:mount.lustre.0 Request processed in 244us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602593.369148:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787602593.370053:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787602593.370315:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787602593.370369:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787602593.370405:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787602593.370469:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787602593.370507:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787602593.370553:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787602593.370605:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787602593.370643:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787602593.370691:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787602593.370722:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787602593.370752:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787602593.370814:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787602593.370851:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787602593.370885:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787602593.370932:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787602593.370986:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787602593.371022:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787602593.371102:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787602593.371141:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787602593.371177:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787602593.371226:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787602593.371263:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787602593.371317:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787602593.371370:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787602593.371408:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787602593.371436:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787602593.371491:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787602593.371524:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787602593.371554:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787602593.371603:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787602593.371642:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787602593.371678:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787602593.371710:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787602593.371754:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787602593.371791:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787602593.371854:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787602593.371894:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787602593.371930:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787602593.372005:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787602593.372117:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787602593.372167:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787602593.372238:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.372276:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a43039600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602593.372398:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839004672 00000100:00100000:0.0:1787602593.372405:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839004672 00000100:00100000:0.0:1787602593.372448:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787602593.372457:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15061:x1874436839004672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602593.372680:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15061:x1874436839004672:12345-0@lo:502:mount.lustre.0 Request processed in 223us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602593.372688:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787602593.381371:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839004672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787602593.381525:0:15061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787602593.381542:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787602593.389292:0:15084:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787602593.389310:0:15084:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff944945144d28) 00000020:00000080:3.0:1787602593.389331:0:15084:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787602593.389424:0:15084:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944a7c906800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787602593.389428:0:15084:0:(tgt_mount.c:187:server_put_mount()) put mount ffff944a7c906800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787602593.389431:0:15084:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944a7c906800 3 00010000:00080000:3.0:1787602593.389461:0:15084:0:(ldlm_lib.c:102:import_set_conn()) imp ffff944a620cf000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.125@tcp at head 00010000:00010000:2.0:1787602593.397123:0:15084:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787602593.397323:0:15084:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787602593.397363:0:15084:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787602593.397378:0:15084:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x576b7af90af479f1 00000100:00080000:2.0:1787602593.397389:0:15084:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787602593.397397:0:15084:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff944a620cf000 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:2.0:1787602593.397434:0:15084:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a7c2d0e00 x1874436839004800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602593.401809:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874436839004800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787602593.401911:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602593.402353:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839004800 00000100:00100000:1.0:1787602593.402361:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839004800 00000100:00100000:1.0:1787602593.402391:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602593.402398:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874436839004800:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787602593.402423:0:14378:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:1.0:1787602593.402471:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x576b7af90af479f8 00000004:00100000:1.0:1787602593.402485:0:14378:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787602593.402516:0:14378:0:(import.c:65:import_set_state_nolock()) ffff944a7be1a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602593.402589:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874436839004800:12345-0@lo:38:llog_process_th.0 Request processed in 189us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602593.402597:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787602593.402641:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff944a7c2d0e00 x1874436839004800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602593.402652:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787602593.402660:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787602593.402668:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787602593.402673:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787602593.402675:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a620cf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787602593.402681:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874436839004800:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787602593.403079:0:15084:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787602593.404739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787602593.404748:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787602593.404750:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787602593.404753:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787602593.404827:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602593.404844:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436839004928:0@lo:400:kworker.0 00000100:00100000:1.0:1787602593.404904:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602593.404953:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839004928 00000100:00100000:1.0:1787602593.404970:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839004928 00000100:00100000:1.0:1787602593.405015:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602593.405024:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436839004928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602593.405106:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436839004928:12345-0@lo:400:kworker.0 Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602593.405112:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787602593.405148:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff944a7c836300 x1874436839004928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602593.405171:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436839004928:0@lo:400:kworker.0 00000040:00080000:3.0:1787602593.406602:0:15084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787602593.407105:0:15061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787602593.407130:0:15061:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787602593.407146:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af479dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479e3 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602593.407159:0:15061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d71400/0x576b7af90af479dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af479e3 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787602593.407214:0:15061:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787602593.407217:0:15061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787602593.407218:0:15061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602593.407219:0:15061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602593.407220:0:15061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602593.407222:0:15061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602593.407223:0:15061:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602593.407225:0:15061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602593.407226:0:15061:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787602593.407231:0:15061:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787602593.407233:0:15061:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787602593.407234:0:15061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787602593.407235:0:15061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602593.407236:0:15061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602593.407237:0:15061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602593.407239:0:15061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602593.407240:0:15061:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602593.407241:0:15061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602593.407247:0:15061:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787602593.407270:0:15061:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787602593.407299:0:15061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c836300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839005056:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787602593.407371:0:15061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602593.407396:0:15061:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc600 going to sleep for 11 seconds 00000100:00100000:0.0:1787602593.408572:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839005056 00000100:00100000:0.0:1787602593.408581:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839005056 00000100:00100000:0.0:1787602593.408627:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787602593.408636:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15061:x1874436839005056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787602593.408663:0:14371:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787602593.408675:0:14371:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787602593.444787:0:14371:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787602593.444822:0:14371:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787602593.445143:0:14394:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787602593.445149:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787602593.445237:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.445256:0:14394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a47d71e00/0x576b7af90af4796c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47965 expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.445274:0:14394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.445319:0:14394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a47d71e00/0x576b7af90af4796c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af47965 expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.445333:0:14394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a47d71e00/0x576b7af90af4796c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af47965 expref: 16 pid: 14371 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602593.445347:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874436839005184:0@lo:104: 00000100:00100000:3.0:1787602593.445414:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.445484:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a430396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602593.445489:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839005184 00000100:00100000:0.0:1787602593.445497:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839005184 00000100:00100000:0.0:1787602593.445546:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602593.445555:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:14394:x1874436839005184:12345-0@lo:104: 00010000:00010000:0.0:1787602593.445567:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602593.445626:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602593.445631:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:14394:x1874436839005184:12345-0@lo:104: Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602593.445638:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787602593.445659:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602593.445665:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602593.445672:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a40031a00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602593.445676:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602593.445685:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602593.445692:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602593.445697:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602593.445723:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602593.445729:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602593.445755:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602593.445762:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a40031a00/0x576b7af90af47965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af4796c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602593.445778:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602593.445780:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602593.445782:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602593.445799:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839005312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602593.445826:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602593.445922:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839005312 00000100:00100000:3.0:1787602593.445926:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839005312 00010000:00010000:3.0:1787602593.445946:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a47d71e00/0x576b7af90af4796c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47965 expref: 17 pid: 14371 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602593.445984:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602593.445993:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:3312:x1874436839005312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602593.446004:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602593.446010:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a47d71e00/0x576b7af90af4796c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47965 expref: 17 pid: 14371 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.446022:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a47d71e00/0x576b7af90af4796c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af47965 expref: 17 pid: 14371 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.446059:0:14365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.446067:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787602593.446079:0:14365:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002783819s 00010000:00010000:3.0:1787602593.446084:0:14365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.446092:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.446099:0:14365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.446117:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.446123:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602593.446127:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.446134:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.446145:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.446156:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602593.446971:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:3312:x1874436839005312:12345-0@lo:103:ldlm_bl.0 Request processed in 965us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602593.446982:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602593.447002:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839005312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602593.447029:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d71e00/0x576b7af90af4796c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af47965 expref: 16 pid: 14371 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602593.447079:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874436839005184:0@lo:104: 00010000:00010000:3.0:1787602593.447094:0:14394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.447104:0:14394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.447111:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602593.447131:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a47d70600/0x576b7af90af479ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602593.452296:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:15061:x1874436839005056:12345-0@lo:253:mount.lustre.0 Request processed in 43653us (44917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602593.452310:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787602593.452417:0:15061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c836300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15061:1874436839005056:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787602593.452431:0:15061:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787602593.452434:0:15061:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787602593.452436:0:15061:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787602593.452437:0:15061:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602593.452439:0:15061:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602593.452440:0:15061:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602593.452441:0:15061:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602593.452442:0:15061:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602593.452444:0:15061:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602593.452445:0:15061:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787602593.452462:0:15061:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787602593.459137:0:15061:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602593.459332:0:15061:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602593.459488:0:15061:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602593.459788:0:15061:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602593.460121:0:15061:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602593.460327:0:15061:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787602593.465144:0:15061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787602593.501234:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787602593.529596:0:15061:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787602593.529603:0:15061:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787602593.529632:0:15061:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787602593.529689:0:15061:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787602593.529706:0:15061:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787602593.529730:0:15061:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:0.0:1787602593.890120:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787602594.525104:0:14375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787602594.525111:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff944946355000 from 7 10000000:01000000:0.0:1787602594.525116:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787602594.525158:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602594.525193:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602594.525205:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602594.525227:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839005440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602594.525293:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602594.525349:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602594.525584:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839005440 00000100:00100000:1.0:1787602594.525591:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839005440 00000100:00100000:1.0:1787602594.525642:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787602594.525651:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+15:14375:x1874436839005440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602594.525673:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602594.525685:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011c800/0x576b7af90af47a0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47a06 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602594.525705:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011c800/0x576b7af90af47a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47a06 expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602594.525715:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011c800/0x576b7af90af47a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47a06 expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602594.525723:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c800, rc 0) 00000100:00100000:1.0:1787602594.525869:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:14375:x1874436839005440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602594.525876:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787602594.526004:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839005440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602594.526019:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602594.526028:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602594.526202:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839005568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787602594.526235:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602594.526254:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47962180 going to sleep for 11 seconds 00010000:00010000:1.0:1787602594.529414:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602594.529725:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839005568 00000100:00100000:0.0:1787602594.529736:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839005568 00000100:00100000:0.0:1787602594.529843:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787602594.531340:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:14375:x1874436839005568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787602594.531370:0:14371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787602594.531384:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787602594.531387:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787602594.531509:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:14375:x1874436839005568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 666us (5272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602594.532151:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839005568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787602594.532211:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787602594.532220:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602594.532231:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602594.532640:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1787602595.550518:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602596.573258:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602597.598240:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787602598.429202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787602598.429209:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787602598.429212:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787602598.429214:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787602598.429263:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436839005952:0@lo:400:kworker.0 00000100:00100000:0.0:1787602598.429324:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602598.429474:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3313:1874436839005696:0@lo:400:kworker.0 00000100:00100000:1.0:1787602598.429509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602598.429549:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602598.429555:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436839005824:0@lo:400:kworker.0 00000100:00100000:1.0:1787602598.429577:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602598.429615:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839005952 00000100:00100000:1.0:1787602598.429622:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839005952 00000100:00100000:1.0:1787602598.429672:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839005824 00000100:00100000:1.0:1787602598.429675:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839005824 00000100:00100000:1.0:1787602598.429690:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602598.429697:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436839005952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602598.429747:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436839005952:12345-0@lo:400:kworker.0 Request processed in 50us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602598.429754:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602598.429768:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602598.429774:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436839005824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602598.429812:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436839005824:12345-0@lo:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602598.429819:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787602598.429855:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9449481c4700 x1874436839005824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602598.429882:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436839005824:0@lo:400:kworker.0 00010000:00080000:1.0:1787602598.429908:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9449481c7480 x1874436839005952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602598.429916:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436839005952:0@lo:400:kworker.0 00000100:00080000:1.0:1787602598.429965:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602598.430143:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839005696 00000100:00100000:0.0:1787602598.430148:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839005696 00000100:00100000:0.0:1787602598.430181:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787602598.430189:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:3313:x1874436839005696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602598.430223:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:3313:x1874436839005696:12345-0@lo:400:kworker.0 Request processed in 35us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602598.430230:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787602598.431895:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3313:1874436839005696:0@lo:400:kworker.0 00010000:00010000:1.0:1787602598.621443:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787602599.125712:0:15428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787602599.645354:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602600.670740:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602601.693252:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602602.724854:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787602603.103953:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1787602603.549215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602603.549222:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787602603.549225:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602603.549228:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787602603.549286:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436839006336:0@lo:400:kworker.0 00000100:00100000:3.0:1787602603.549354:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602603.549413:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602603.549420:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436839006208:0@lo:400:kworker.0 00000100:00100000:3.0:1787602603.549442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602603.549484:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839006336 00000100:00100000:3.0:1787602603.549491:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839006336 00000100:00100000:1.0:1787602603.549532:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602603.549540:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839006208 00000100:00100000:3.0:1787602603.549544:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839006208 00000100:00100000:1.0:1787602603.549545:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3311:1874436839006080:0@lo:400:kworker.0 00000100:00100000:3.0:1787602603.549561:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787602603.549570:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436839006336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602603.549589:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602603.549633:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874436839006336:12345-0@lo:400:kworker.0 Request processed in 62us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602603.549634:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839006080 00000100:00100000:1.0:1787602603.549639:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839006080 00000100:00100000:3.0:1787602603.549644:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602603.549671:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787602603.549673:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602603.549681:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:3311:x1874436839006080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602603.549686:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436839006208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602603.549732:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874436839006208:12345-0@lo:400:kworker.0 Request processed in 50us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602603.549735:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:3311:x1874436839006080:12345-0@lo:400:kworker.0 Request processed in 55us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602603.549744:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602603.549748:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787602603.549792:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3311:1874436839006080:0@lo:400:kworker.0 00000100:00080000:1.0:1787602603.549914:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787602603.550082:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a4d3d8000 x1874436839006208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602603.550094:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874436839006208:0@lo:400:kworker.0 00010000:00080000:3.0:1787602603.550104:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a4d3d8700 x1874436839006336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602603.550113:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874436839006336:0@lo:400:kworker.0 00010000:00010000:0.0:1787602603.741143:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602604.767581:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787602605.539280:0:15777:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787602605.539285:0:15777:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787602605.539397:0:15777:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff944a7554e000 00000020:01000004:2.0:1787602605.539410:0:15777:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787602605.539423:0:15777:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787602605.539437:0:15777:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff944a4a393370) 00000020:00000080:2.0:1787602605.539451:0:15777:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787602605.554712:0:15777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787602605.554944:0:15777:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787602605.555771:0:15777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787602605.556020:0:15777:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787602605.556326:0:15777:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787602605.556648:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 429: rc = 0 00100000:10000000:2.0:1787602605.556774:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 429: rc = 0 00100000:10000000:2.0:1787602605.556861:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 429: rc = 0 00100000:10000000:2.0:1787602605.557300:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1787602605.558495:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787602605.558891:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1787602605.559218:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787602605.559453:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1787602605.559684:0:15777:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00000020:00000080:2.0:1787602605.560314:0:15777:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787602605.560325:0:15777:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787602605.560335:0:15777:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x576b7af90af47a1b 00000020:01000004:2.0:1787602605.560342:0:15777:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787602605.560362:0:15777:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787602605.560364:0:15777:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787602605.560370:0:15777:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787602605.560389:0:15777:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787602605.560393:0:15777:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787602605.575614:0:15777:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787602605.575651:0:15777:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.125@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787602605.575655:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787602605.575657:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787602605.575658:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602605.575659:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602605.575660:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602605.575661:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602605.575663:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602605.575665:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602605.575666:0:15777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787602605.575669:0:15777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787602605.575671:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787602605.575672:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787602605.575673:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602605.575674:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602605.575675:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602605.575676:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602605.575677:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602605.575678:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602605.575679:0:15777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787602605.575705:0:15777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787602605.575725:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839006464:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787602605.575792:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602605.578185:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47962300 going to sleep for 11 seconds 00000100:00100000:0.0:1787602605.579311:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839006464 00000100:00100000:0.0:1787602605.579323:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839006464 00000100:00100000:0.0:1787602605.579373:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787602605.579382:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15777:x1874436839006464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787602605.579412:0:14373:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787602605.579415:0:14373:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787602605.579418:0:14373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787602605.589854:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15777:x1874436839006464:12345-0@lo:253:mount.lustre.0 Request processed in 10465us (14055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602605.589867:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787602605.590022:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839006464:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787602605.590079:0:15777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787602605.590082:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787602605.590083:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787602605.590085:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602605.590086:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602605.590087:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602605.590088:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602605.590089:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602605.590091:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602605.590092:0:15777:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787602605.590109:0:15777:0:(tgt_mount.c:101:server_register_mount()) register mount ffff944a7554e000 from lustre-OST0001 10000000:01000000:3.0:1787602605.590132:0:15777:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787602605.590135:0:15777:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787602605.590142:0:15777:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff944a469a0000 local copy 00010000:00010000:3.0:1787602605.590151:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47893 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602605.590358:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839006592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602605.590394:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602605.590433:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47962a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602605.590487:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839006592 00000100:00100000:0.0:1787602605.590493:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839006592 00000100:00100000:0.0:1787602605.590533:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787602605.590542:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15777:x1874436839006592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602605.590675:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15777:x1874436839006592:12345-0@lo:501:mount.lustre.0 Request processed in 133us (280us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787602605.590690:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787602605.591765:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839006592:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787602605.591790:0:15777:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787602605.592113:0:15777:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787602605.592121:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47893 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602605.592132:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d70400/0x576b7af90af4788c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47893 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602605.592154:0:15777:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff944a7554e000 10000000:01000000:3.0:1787602605.592162:0:15777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787602605.592167:0:15777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787602605.592170:0:15777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787602605.592174:0:15777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787602605.592176:0:15777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787602605.592201:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70600/0x576b7af90af47a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602605.592209:0:15777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a47d70600/0x576b7af90af47a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602605.592219:0:15777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a47d70600/0x576b7af90af47a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602605.592235:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839006720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787602605.592275:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602605.592358:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47962a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602605.594015:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839006720 00000100:00100000:0.0:1787602605.594029:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839006720 00000100:00100000:0.0:1787602605.594100:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787602605.594110:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:15777:x1874436839006720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602605.594127:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602605.594434:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011c600/0x576b7af90af47a29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47a22 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.594461:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011c600/0x576b7af90af47a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47a22 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.594486:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011c600/0x576b7af90af47a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47a22 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.594494:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c600, rc 0) 00000100:00100000:1.0:1787602605.594564:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:15777:x1874436839006720:12345-0@lo:101:mount.lustre.0 Request processed in 455us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602605.594571:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787602605.594667:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839006720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787602605.594684:0:15777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a47d70600/0x576b7af90af47a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a29 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602605.594693:0:15777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a47d70600/0x576b7af90af47a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47a29 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787602605.595401:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787602605.596208:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602605.596452:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787602605.596499:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787602605.596531:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787602605.596577:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787602605.596617:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787602605.596650:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787602605.596726:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787602605.596734:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787602605.596803:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839006848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602605.596856:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602605.596920:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602605.597600:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839006848 00000100:00100000:1.0:1787602605.597609:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839006848 00000100:00100000:1.0:1787602605.597649:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787602605.597659:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:15777:x1874436839006848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602605.598022:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:15777:x1874436839006848:12345-0@lo:501:mount.lustre.0 Request processed in 363us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602605.598030:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787602605.599565:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839006848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602605.599623:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839006976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787602605.599690:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602605.599729:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602605.602691:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839006976 00000100:00100000:1.0:1787602605.602705:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839006976 00000100:00100000:1.0:1787602605.602778:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787602605.602790:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:15777:x1874436839006976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602605.603461:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:15777:x1874436839006976:12345-0@lo:503:mount.lustre.0 Request processed in 672us (3770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602605.603470:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787602605.603626:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839006976:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787602605.605195:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787602605.605286:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787602605.605349:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602605.605396:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602605.605587:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839007104 00000100:00100000:0.0:1787602605.605595:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839007104 00000100:00100000:0.0:1787602605.605641:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787602605.605650:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:15777:x1874436839007104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602605.605863:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:15777:x1874436839007104:12345-0@lo:502:mount.lustre.0 Request processed in 214us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602605.605871:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787602605.606234:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787602605.606481:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787602605.606530:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787602605.606562:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787602605.606609:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787602605.606646:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787602605.606678:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787602605.606734:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787602605.606976:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787602605.607084:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787602605.607119:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787602605.607168:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602605.607211:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602605.607455:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839007232 00000100:00100000:1.0:1787602605.607461:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839007232 00000100:00100000:1.0:1787602605.607540:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787602605.607550:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:15777:x1874436839007232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602605.607715:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:15777:x1874436839007232:12345-0@lo:502:mount.lustre.0 Request processed in 166us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602605.607729:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787602605.607811:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787602605.607874:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787602605.607884:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787602605.611272:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787602605.611281:0:15778:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787602605.611286:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602605.611289:0:15778:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787602605.611293:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787602605.611308:0:15778:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff944a4a3919b8) 00000020:00000080:2.0:1787602605.611356:0:15778:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787602605.611362:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787602605.611428:0:15778:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944a7554e000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787602605.611434:0:15778:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787602605.611440:0:15778:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x576b7af90af47a37 00010000:00010000:3.0:1787602605.620157:0:15778:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787602605.620532:0:15778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787602605.623500:0:15778:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787602605.625072:0:15778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787602605.625082:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602605.625088:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602605.625090:0:15778:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787602605.625093:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602605.625097:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602605.625098:0:15778:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787602605.625101:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787602605.625103:0:15778:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787602605.625105:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602605.625107:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602605.625116:0:15778:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787602605.625120:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602605.625123:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602605.625124:0:15778:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787602605.625127:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787602605.625180:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602605.625183:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602605.625185:0:15778:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787602605.625188:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787602605.625417:0:15777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787602605.625461:0:15777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787602605.625481:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a47d70600/0x576b7af90af47a22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a29 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.625492:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a47d70600/0x576b7af90af47a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a29 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602605.625500:0:15777:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a7554e000 from 1 10000000:01000000:0.0:1787602605.625503:0:15777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602605.625534:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.625542:0:15777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.625565:0:15777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602605.625587:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787602605.625649:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602605.625691:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48924e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602605.625789:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839007360 00000100:00100000:1.0:1787602605.625797:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839007360 00000100:00100000:1.0:1787602605.625841:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787602605.625851:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449450cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:15777:x1874436839007360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602605.625863:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602605.625874:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011c200/0x576b7af90af47a45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47a3e expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.625913:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011c200/0x576b7af90af47a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47a3e expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.625924:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011c200/0x576b7af90af47a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47a3e expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.625932:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c200, rc 0) 00000100:00100000:1.0:1787602605.626122:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449450cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839007360:12345-0@lo:101:mount.lustre.0 Request processed in 271us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602605.626129:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787602605.627189:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602605.627210:0:15777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602605.627221:0:15777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787602605.627671:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787602605.629460:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787602605.629702:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787602605.629751:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787602605.629827:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787602605.629838:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787602605.632050:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602605.632113:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602605.632162:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839007488 00000100:00100000:3.0:1787602605.632169:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839007488 00000100:00100000:3.0:1787602605.632213:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787602605.632222:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449450cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839007488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602605.632448:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449450cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839007488:12345-0@lo:501:mount.lustre.0 Request processed in 226us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602605.632466:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787602605.632511:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a479620c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602605.632530:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602605.632564:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602605.632600:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602605.632623:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a479620c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602605.633033:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839007616 00000100:00100000:1.0:1787602605.633064:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839007616 00000100:00100000:1.0:1787602605.633095:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787602605.633101:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449450c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839007616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602605.633249:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449450c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839007616:12345-0@lo:503:mount.lustre.0 Request processed in 147us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602605.633256:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787602605.633355:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007616:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787602605.633809:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787602605.633868:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787602605.634629:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602605.635372:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787602605.636418:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839007744 00000100:00100000:3.0:1787602605.636429:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839007744 00000100:00100000:1.0:1787602605.636743:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787602605.636764:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449450c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839007744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602605.637100:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449450c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839007744:12345-0@lo:502:mount.lustre.0 Request processed in 340us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602605.637109:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787602605.637701:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602605.638023:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787602605.638103:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787602605.638151:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787602605.638186:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787602605.638218:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787602605.638264:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787602605.638300:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787602605.638330:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787602605.638485:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602605.638545:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602605.638587:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48924480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602605.638666:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839007872 00000100:00100000:1.0:1787602605.638673:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839007872 00000100:00100000:1.0:1787602605.638743:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787602605.638752:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7cb1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839007872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602605.638934:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7cb1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839007872:12345-0@lo:502:mount.lustre.0 Request processed in 183us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602605.638942:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787602605.639013:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839007872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787602605.639116:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787602605.639126:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787602605.640382:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602605.640393:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602605.640395:0:15782:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787602605.640402:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944a7554e000 00000020:00000080:0.0:1787602605.640404:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787602605.640410:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602605.640412:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602605.640413:0:15782:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787602605.640415:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602605.640417:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602605.640424:0:15782:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787602605.640428:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff944a7554e000 00000020:00000080:0.0:1787602605.640430:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787602605.640515:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602605.640519:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602605.640521:0:15782:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787602605.640523:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602605.640526:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602605.640528:0:15782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787602605.640531:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff944a7554e000 00000020:00000080:0.0:1787602605.640533:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787602605.643846:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602605.643857:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602605.643859:0:15782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787602605.643865:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787602605.644097:0:15777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787602605.644123:0:15777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787602605.647348:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.647366:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602605.647422:0:15777:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787602605.647425:0:15777:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff944a7554e000 10000000:01000000:1.0:1787602605.647428:0:15777:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff944a7554e000 10000000:01000000:1.0:1787602605.647432:0:15777:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787602605.647437:0:15777:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff944a7554e000 from 1 10000000:01000000:1.0:1787602605.647439:0:15777:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787602605.647470:0:15777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011da00/0x576b7af90af47a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.647478:0:15777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5011da00/0x576b7af90af47a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.647495:0:15777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5011da00/0x576b7af90af47a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602605.647517:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839008000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787602605.647701:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602605.647743:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602605.647947:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839008000 00000100:00100000:0.0:1787602605.647955:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839008000 00000100:00100000:0.0:1787602605.648464:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787602605.648475:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839008000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602605.648488:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602605.648499:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a7c458200/0x576b7af90af47a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47a4c expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.648536:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a7c458200/0x576b7af90af47a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47a4c expref: 19 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.648547:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a7c458200/0x576b7af90af47a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47a4c expref: 19 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.648556:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458200, rc 0) 00000100:00100000:0.0:1787602605.648599:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:15777:x1874436839008000:12345-0@lo:101:mount.lustre.0 Request processed in 127us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602605.648611:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787602605.648700:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839008000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602605.648715:0:15777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5011da00/0x576b7af90af47a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a53 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.648724:0:15777:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5011da00/0x576b7af90af47a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47a53 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602605.649394:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787602605.649767:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602605.650025:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787602605.650088:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787602605.650123:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787602605.650201:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787602605.650239:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787602605.650288:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787602605.650329:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787602605.650364:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787602605.650409:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787602605.650443:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787602605.650475:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787602605.650519:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787602605.650549:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787602605.650577:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787602605.650630:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787602605.650665:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787602605.650697:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787602605.650742:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787602605.650774:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787602605.650818:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787602605.650864:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787602605.650913:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787602605.650946:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787602605.650994:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787602605.651027:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787602605.651080:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787602605.651121:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787602605.651151:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787602605.651178:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787602605.651219:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787602605.651251:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787602605.651280:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787602605.651312:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787602605.651352:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787602605.651382:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787602605.655632:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787602605.655731:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787602605.655831:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787602605.655840:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787602605.655957:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839008128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602605.656017:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602605.656072:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787602605.656527:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839008128 00000100:00100000:3.0:1787602605.656535:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839008128 00000100:00100000:3.0:1787602605.656572:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787602605.656581:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:15777:x1874436839008128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602605.656787:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:15777:x1874436839008128:12345-0@lo:501:mount.lustre.0 Request processed in 206us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602605.656795:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787602605.658240:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839008128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602605.658285:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839008256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602605.658339:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602605.658372:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602605.660456:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839008256 00000100:00100000:0.0:1787602605.660466:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839008256 00000100:00100000:0.0:1787602605.660528:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787602605.660539:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:15777:x1874436839008256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602605.660739:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:15777:x1874436839008256:12345-0@lo:503:mount.lustre.0 Request processed in 201us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602605.660747:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787602605.660847:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839008256:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787602605.661364:0:15777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787602605.661422:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839008384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602605.661461:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602605.661490:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602605.661600:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839008384 00000100:00100000:0.0:1787602605.661606:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839008384 00000100:00100000:0.0:1787602605.661639:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787602605.661647:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:15777:x1874436839008384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602605.661799:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:15777:x1874436839008384:12345-0@lo:502:mount.lustre.0 Request processed in 153us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602605.661807:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787602605.661876:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839008384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787602605.662142:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787602605.662183:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787602605.662212:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787602605.662252:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787602605.662280:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787602605.662328:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787602605.662357:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787602605.662386:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787602605.662828:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787602605.662870:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787602605.662931:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787602605.662981:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787602605.663017:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787602605.671424:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787602605.671533:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787602605.671575:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787602605.671612:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787602605.671664:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787602605.671702:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787602605.671739:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787602605.671789:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787602605.671845:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787602605.671880:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787602605.671953:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787602605.671994:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787602605.672031:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787602605.672130:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787602605.672168:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787602605.672202:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787602605.672251:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787602605.672287:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787602605.672321:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787602605.672356:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787602605.672406:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787602605.672443:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787602605.672491:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787602605.672528:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787602605.672569:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787602605.672612:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787602605.672647:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787602605.672696:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839008512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602605.672769:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602605.672806:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602605.673012:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839008512 00000100:00100000:0.0:1787602605.673020:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839008512 00000100:00100000:0.0:1787602605.673087:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787602605.673098:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:15777:x1874436839008512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602605.673307:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:15777:x1874436839008512:12345-0@lo:502:mount.lustre.0 Request processed in 211us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602605.673314:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787602605.673402:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839008512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787602605.673468:0:15777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787602605.673477:0:15777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787602605.674362:0:15787:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787602605.674378:0:15787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff944a4a390000) 00000020:00000080:2.0:1787602605.674408:0:15787:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787602605.674495:0:15787:0:(tgt_mount.c:153:server_get_mount()) get mount ffff944a7554e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787602605.674499:0:15787:0:(tgt_mount.c:187:server_put_mount()) put mount ffff944a7554e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787602605.674502:0:15787:0:(obd_mount.c:710:lustre_put_lsi()) put ffff944a7554e000 3 00010000:00080000:2.0:1787602605.674531:0:15787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff944947812800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.125@tcp at head 00010000:00010000:2.0:1787602605.676705:0:15787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787602605.676938:0:15787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787602605.676968:0:15787:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787602605.676978:0:15787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x576b7af90af47a61 00000100:00080000:2.0:1787602605.676988:0:15787:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787602605.676993:0:15787:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff944947812800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:2.0:1787602605.677025:0:15787:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a7c2d1c00 x1874436839008640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787602605.677077:0:15787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787602605.677209:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602605.677215:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787602605.677217:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602605.677220:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787602605.677281:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436839008896:0@lo:400:kworker.0 00000100:00100000:3.0:1787602605.677338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602605.677370:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602605.677376:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436839008768:0@lo:400:kworker.0 00000100:00100000:3.0:1787602605.677397:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602605.677434:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839008896 00000100:00100000:3.0:1787602605.677441:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839008896 00000100:00100000:3.0:1787602605.677486:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839008768 00000100:00100000:3.0:1787602605.677489:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839008768 00000100:00100000:3.0:1787602605.677505:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602605.677514:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436839008896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602605.677563:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436839008896:12345-0@lo:400:kworker.0 Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602605.677570:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602605.677596:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787602605.677602:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436839008768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602605.677628:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436839008768:12345-0@lo:400:kworker.0 Request processed in 26us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602605.677634:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787602605.677654:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787602605.677679:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a4d3d8000 x1874436839008768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602605.677691:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436839008768:0@lo:400:kworker.0 00010000:00080000:3.0:1787602605.677701:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a4d3d8700 x1874436839008896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602605.677709:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436839008896:0@lo:400:kworker.0 00000100:00100000:1.0:1787602605.677787:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874436839008640:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787602605.677819:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602605.677982:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839008640 00000100:00100000:3.0:1787602605.677986:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839008640 00000100:00100000:3.0:1787602605.678012:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602605.678017:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874436839008640:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787602605.678063:0:14380:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:3.0:1787602605.678096:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x576b7af90af47a68 00000004:00100000:3.0:1787602605.678110:0:14380:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787602605.678136:0:14380:0:(import.c:65:import_set_state_nolock()) ffff944a576b1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602605.678178:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874436839008640:12345-0@lo:38:llog_process_th.0 Request processed in 160us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602605.678184:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787602605.678293:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff944a7c2d1c00 x1874436839008640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602605.678302:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787602605.678308:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787602605.678314:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787602605.678318:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787602605.678320:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944947812800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787602605.678325:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874436839008640:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787602605.683838:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787602605.684376:0:15777:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787602605.684419:0:15777:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787602605.684440:0:15777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011da00/0x576b7af90af47a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a53 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.684451:0:15777:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5011da00/0x576b7af90af47a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47a53 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787602605.684511:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787602605.684513:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787602605.684514:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602605.684516:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602605.684517:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602605.684518:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602605.684520:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602605.684521:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602605.684523:0:15777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787602605.684526:0:15777:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787602605.684528:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787602605.684529:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787602605.684531:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602605.684532:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602605.684532:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602605.684534:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602605.684535:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602605.684536:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602605.684537:0:15777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787602605.684559:0:15777:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787602605.684576:0:15777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839009024:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787602605.684635:0:15777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602605.684706:0:15777:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a494b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602605.684871:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839009024 00000100:00100000:0.0:1787602605.684879:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839009024 00000100:00100000:0.0:1787602605.685024:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787602605.685379:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:15777:x1874436839009024:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787602605.685415:0:14372:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787602605.685428:0:14372:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787602605.717795:0:14372:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787602605.717812:0:14372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787602605.717988:0:14394:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787602605.717993:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787602605.718015:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.718032:0:14394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a5011c800/0x576b7af90af47a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47a06 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.718071:0:14394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.718108:0:14394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a5011c800/0x576b7af90af47a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af47a06 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.718121:0:14394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a5011c800/0x576b7af90af47a0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af47a06 expref: 19 pid: 14372 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602605.718136:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874436839009152:0@lo:104: 00000100:00100000:0.0:1787602605.718194:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602605.718238:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff94494535bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602605.718536:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839009152 00000100:00100000:1.0:1787602605.718544:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839009152 00000100:00100000:1.0:1787602605.718590:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602605.718600:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:14394:x1874436839009152:12345-0@lo:104: 00010000:00010000:1.0:1787602605.718611:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602605.718661:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602605.718681:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:14394:x1874436839009152:12345-0@lo:104: Request processed in 84us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602605.718689:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787602605.719008:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602605.719015:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719023:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458a00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:0.0:1787602605.719026:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719034:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602605.719076:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602605.719082:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602605.719116:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719123:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602605.719142:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719148:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47a06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af47a0d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719165:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602605.719167:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602605.719169:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602605.719190:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3313:1874436839009280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602605.719239:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602605.719287:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839009280 00000100:00100000:0.0:1787602605.719292:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839009280 00010000:00010000:0.0:1787602605.719311:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a5011c800/0x576b7af90af47a0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47a06 expref: 20 pid: 14372 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602605.719333:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787602605.719340:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+20:3313:x1874436839009280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787602605.719349:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602605.719354:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a5011c800/0x576b7af90af47a0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47a06 expref: 20 pid: 14372 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719370:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a5011c800/0x576b7af90af47a0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af47a06 expref: 20 pid: 14372 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719385:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719392:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787602605.719405:0:14363:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002783819s 00010000:00010000:0.0:1787602605.719409:0:14363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719415:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719421:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719427:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719433:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459000 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602605.719436:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719443:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719452:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719468:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602605.719498:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+20:3313:x1874436839009280:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602605.719504:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787602605.719540:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3313:1874436839009280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787602605.719579:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5011c800/0x576b7af90af47a0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af47a06 expref: 19 pid: 14372 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602605.719589:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14394:1874436839009152:0@lo:104: 00010000:00010000:0.0:1787602605.719601:0:14394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719608:0:14394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719614:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602605.719620:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a7c459000/0x576b7af90af47a6f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602605.726673:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:15777:x1874436839009024:12345-0@lo:253:mount.lustre.0 Request processed in 41633us (42031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602605.726686:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787602605.726806:0:15777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0c3bd976-3721-4ec4-bd04-79d86542b9eb:15777:1874436839009024:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787602605.726820:0:15777:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787602605.726823:0:15777:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787602605.726825:0:15777:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787602605.726826:0:15777:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602605.726827:0:15777:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602605.726829:0:15777:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602605.726830:0:15777:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602605.726831:0:15777:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602605.726833:0:15777:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602605.726834:0:15777:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787602605.726846:0:15777:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787602605.733992:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602605.734274:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602605.734424:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602605.734573:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602605.734719:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602605.735218:0:15777:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787602605.735872:0:15777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787602605.778841:0:15777:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787602605.778849:0:15777:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787602605.778964:0:15777:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787602605.779020:0:15777:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.125@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787602605.779231:0:15777:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787602605.779323:0:15777:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787602605.798074:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602606.690808:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602591/real 1787602591] req@ffff9449481c7800 x1874436839002240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602606.690844:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9449481c7800 x1874436839002240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602606.690856:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602591/real 1787602591] req@ffff9449481c5880 x1874436839002368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602606 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602606.690867:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9449481c5880 x1874436839002368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602606 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787602606.690898:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a7c0c8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787602606.690977:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787602606.691000:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436839002240:0@lo:8:kworker.0 00000100:00080000:1.0:1787602606.691007:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a47d9c800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787602606.691358:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3314:1874436839009408:0@lo:400:kworker.0 00000100:00100000:0.0:1787602606.691454:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787602606.691554:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602606.691560:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787602606.691564:0:8:0:(import.c:65:import_set_state_nolock()) ffff944a7c0c8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787602606.691572:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 422 00000100:00080000:3.0:1787602606.691580:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787602606.691589:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff944a7c0c8800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:3.0:1787602606.691632:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a4d3d8000 x1874436839009536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787602606.691644:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602606.691647:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787602606.691649:0:8:0:(import.c:65:import_set_state_nolock()) ffff944a47d9c800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787602606.691652:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 422 00000100:00080000:3.0:1787602606.691655:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787602606.691659:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff944a47d9c800 using connection 192.168.206.125@tcp/0@lo 00000100:00100000:3.0:1787602606.691673:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff944a4d3d9180 x1874436839009664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602606.692138:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787602606.692149:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436839010048:0@lo:400:kworker.0 00000100:00080000:1.0:1787602606.692182:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787602606.692188:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436839002368:0@lo:8:kworker.0 00000100:00100000:0.0:1787602606.692202:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602606.692231:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839009408 00000100:00100000:1.0:1787602606.692240:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839009408 00000100:00100000:0.0:1787602606.692250:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436839009536:0@lo:8:kworker.0 00000100:00100000:0.0:1787602606.692277:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602606.692294:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787602606.692305:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a76190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:3314:x1874436839009408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602606.692307:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839009536 00000100:00100000:0.0:1787602606.692311:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839009536 00000100:00100000:0.0:1787602606.692339:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602606.692345:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874436839009536:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787602606.692372:0:15063:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:0.0:1787602606.692413:0:15063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x576b7af90af47a76 00002000:00100000:0.0:1787602606.697333:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff944a752c2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787602606.697348:0:15063:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787602606.697351:0:15063:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787602606.697784:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787602606.697827:0:15063:0:(import.c:65:import_set_state_nolock()) ffff944a752c5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787602606.697949:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874436839009536:12345-0@lo:8:kworker.0 Request processed in 5601us (5669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602606.697980:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787602606.698093:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a4d3d8000 x1874436839009536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787602626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602606.698108:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787602606.698129:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787602606.698140:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787602606.698146:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787602606.698149:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a7c0c8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787602606.698171:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787602606.698177:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436839009536:0@lo:8:kworker.0 00000004:00080000:0.0:1787602606.698193:0:14399:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787602606.698463:0:14399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437804425860ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787602606.698527:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436839009664:0@lo:8:kworker.0 00000100:00100000:0.0:1787602606.698577:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602606.698695:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3314:1874436839009408:0@lo:400:kworker.0 00000004:00080000:2.0:1787602606.699193:0:14401:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787602606.699220:0:14401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14401:1874436839010304:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787602606.699457:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436839010176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602606.699519:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602606.699629:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a76190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:3314:x1874436839009408:12345-0@lo:400:kworker.0 Request processed in 7323us (8171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602606.699644:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787602606.699823:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839009664 00000100:00100000:2.0:1787602606.699832:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839009664 00000100:00100000:2.0:1787602606.699865:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602606.699873:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874436839009664:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787602606.699916:0:15065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000100:00100000:3.0:1787602606.700151:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436839009792:0@lo:400:kworker.0 00000100:00100000:3.0:1787602606.700195:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602606.700234:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602606.700241:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436839009920:0@lo:400:kworker.0 00000100:00100000:3.0:1787602606.700267:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602606.700303:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839010048 00000100:00100000:3.0:1787602606.700308:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839010048 00000100:00100000:3.0:1787602606.700346:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839009792 00000100:00100000:3.0:1787602606.700350:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839009792 00000100:00100000:3.0:1787602606.700362:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839009920 00000100:00100000:3.0:1787602606.700364:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839009920 00000100:00100000:3.0:1787602606.700378:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602606.700384:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436839010048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602606.700437:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436839010048:12345-0@lo:400:kworker.0 Request processed in 52us (8233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602606.700445:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602606.700463:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787602606.700469:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436839009792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602606.700499:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436839009792:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602606.700505:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787602606.700536:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787602606.700543:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436839009920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602606.700571:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436839009920:12345-0@lo:400:kworker.0 Request processed in 29us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602606.700576:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787602606.700601:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787602606.700731:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a4d3d9500 x1874436839009920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602606.700760:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436839009920:0@lo:400:kworker.0 00010000:00080000:3.0:1787602606.700777:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a4d3d9f80 x1874436839009792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602606.700786:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436839009792:0@lo:400:kworker.0 00000020:00000080:2.0:1787602606.700982:0:15065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x576b7af90af47a7d 00002000:00100000:2.0:1787602606.700999:0:15065:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff944947817800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787602606.701004:0:15065:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787602606.701007:0:15065:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787602606.701392:0:15065:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787602606.701425:0:15065:0:(import.c:65:import_set_state_nolock()) ffff944947811800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602606.701499:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874436839009664:12345-0@lo:8:kworker.0 Request processed in 1624us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602606.701507:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602606.701553:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839010176 00000100:00100000:2.0:1787602606.701558:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839010176 00000100:00100000:2.0:1787602606.701601:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602606.701609:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874436839010176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602606.701639:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602606.701679:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874436839010176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602606.701686:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787602606.701732:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a4d3d9180 x1874436839009664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787602626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602606.701744:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787602606.701753:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787602606.701761:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787602606.701768:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787602606.701770:0:3310:0:(import.c:65:import_set_state_nolock()) ffff944a47d9c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787602606.701774:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787602606.701790:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787602606.701796:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874436839009664:0@lo:8:kworker.0 00000100:00100000:2.0:1787602606.701816:0:14401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602606.701836:0:14401:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc900 going to sleep for 11 seconds 00000100:00100000:0.0:1787602606.701840:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839010304 00000100:00100000:0.0:1787602606.701843:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839010304 00000100:00100000:0.0:1787602606.701873:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602606.701880:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14401:x1874436839010304:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787602606.701991:0:14402:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787602606.702374:0:14402:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437808324210ns, next at 0ns, rc = 0 00010000:00080000:2.0:1787602606.703182:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c2d1c00 x1874436839010176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602606.703210:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436839010176:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787602606.703295:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a4d3dbb80 x1874436839010048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602606.703305:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436839010048:0@lo:400:kworker.0 00000004:00080000:2.0:1787602606.704190:0:14403:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787602606.704216:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14403:1874436839010560:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787602606.704298:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602606.704343:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc9c0 going to sleep for 11 seconds 00002000:00080000:0.0:1787602606.704826:0:15063:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787602606.704836:0:15063:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787602606.704842:0:15063:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:2.0:1787602606.705537:0:15064:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787602606.705550:0:15064:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787602606.706284:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436839010432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602606.706409:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602606.707000:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839010560 00000100:00100000:1.0:1787602606.707011:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839010560 00000100:00080000:1.0:1787602606.707100:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602606.709210:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602606.709231:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14403:x1874436839010560:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787602606.709496:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839010432 00000100:00100000:2.0:1787602606.709517:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839010432 00000100:00100000:2.0:1787602606.709572:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602606.709583:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874436839010432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602606.709602:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602606.710056:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874436839010432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 454us (3624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602606.710067:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787602606.710077:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c2d1c00 x1874436839010432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602606.710106:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436839010432:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1787602606.713530:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602606.713546:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab31f87/0x576b7af90af47a84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.713566:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787602606.713572:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602606.713640:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dab31f87/0x576b7af90af47a84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.713667:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dab31f87/0x576b7af90af47a84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.713680:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab31f87/0x576b7af90af47a84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.713689:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dab31f87/0x576b7af90af47a84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.713712:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602606.713727:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602606.713734:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dab31f87/0x576b7af90af47a84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.713742:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458c00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.713754:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab31f87/0x576b7af90af47a84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.713765:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab31f87/0x576b7af90af47a84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.713787:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dab31f87/0x576b7af90af47a84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.713796:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dab31f87/0x576b7af90af47a84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.713813:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.713815:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.713817:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787602606.713963:0:15842:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787602606.713973:0:15842:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787602606.713980:0:15842:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1787602606.714769:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602606.714779:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cbf6b1/0x576b7af90af47a8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.714791:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787602606.714796:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602606.714802:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cbf6b1/0x576b7af90af47a8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.714815:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6cbf6b1/0x576b7af90af47a8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.714824:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cbf6b1/0x576b7af90af47a8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.714840:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cbf6b1/0x576b7af90af47a8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.714874:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602606.717687:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.717703:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e22736dc/0x576b7af90af47a92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.717725:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.717730:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.717737:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e22736dc/0x576b7af90af47a92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.717764:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e22736dc/0x576b7af90af47a92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.717777:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e22736dc/0x576b7af90af47a92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.717786:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e22736dc/0x576b7af90af47a92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.717807:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787602606.717821:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602606.717829:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6cbf6b1/0x576b7af90af47a8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.717838:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458000 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.717844:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cbf6b1/0x576b7af90af47a8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.717854:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cbf6b1/0x576b7af90af47a8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.717875:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6cbf6b1/0x576b7af90af47a8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.717883:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6cbf6b1/0x576b7af90af47a8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718092:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.718112:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e22736dc/0x576b7af90af47a92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718118:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.718121:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e22736dc/0x576b7af90af47a92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718127:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e22736dc/0x576b7af90af47a92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718136:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e22736dc/0x576b7af90af47a92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718141:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e22736dc/0x576b7af90af47a92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718173:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.718175:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.718177:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.718753:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.718760:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c067a7/0x576b7af90af47a99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718771:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.718782:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.718788:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021c067a7/0x576b7af90af47a99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718798:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021c067a7/0x576b7af90af47a99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718808:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021c067a7/0x576b7af90af47a99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718816:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021c067a7/0x576b7af90af47a99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718831:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.718840:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.718844:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021c067a7/0x576b7af90af47a99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718851:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.718856:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c067a7/0x576b7af90af47a99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718862:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021c067a7/0x576b7af90af47a99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718870:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021c067a7/0x576b7af90af47a99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718900:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021c067a7/0x576b7af90af47a99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.718915:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.718917:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.718919:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.719366:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.719372:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ee91d2/0x576b7af90af47aa0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.719381:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.719385:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.719389:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073ee91d2/0x576b7af90af47aa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.719399:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073ee91d2/0x576b7af90af47aa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.719407:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ee91d2/0x576b7af90af47aa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.719414:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073ee91d2/0x576b7af90af47aa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.719429:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.719438:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.719448:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073ee91d2/0x576b7af90af47aa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.719456:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477a00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.719460:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ee91d2/0x576b7af90af47aa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.719469:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073ee91d2/0x576b7af90af47aa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.719482:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073ee91d2/0x576b7af90af47aa0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.719489:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073ee91d2/0x576b7af90af47aa0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.719502:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.719504:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.719505:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.720025:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.720032:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76b62af/0x576b7af90af47aa7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720064:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.720068:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.720072:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e76b62af/0x576b7af90af47aa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720091:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e76b62af/0x576b7af90af47aa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720100:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e76b62af/0x576b7af90af47aa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720107:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e76b62af/0x576b7af90af47aa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720121:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.720131:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.720136:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e76b62af/0x576b7af90af47aa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720143:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.720147:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76b62af/0x576b7af90af47aa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720155:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e76b62af/0x576b7af90af47aa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720165:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e76b62af/0x576b7af90af47aa7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720173:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e76b62af/0x576b7af90af47aa7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720194:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.720197:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.720199:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.720680:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.720686:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae44a846/0x576b7af90af47aae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720696:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.720699:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.720703:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae44a846/0x576b7af90af47aae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720713:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae44a846/0x576b7af90af47aae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720721:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae44a846/0x576b7af90af47aae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720729:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae44a846/0x576b7af90af47aae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720744:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.720753:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.720757:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae44a846/0x576b7af90af47aae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720774:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476c00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.720778:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae44a846/0x576b7af90af47aae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720785:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae44a846/0x576b7af90af47aae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720795:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae44a846/0x576b7af90af47aae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720802:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae44a846/0x576b7af90af47aae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.720816:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.720818:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.720819:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.721809:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.721818:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c72e1ad/0x576b7af90af47ab5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.721830:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.721834:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.721839:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c72e1ad/0x576b7af90af47ab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.721850:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c72e1ad/0x576b7af90af47ab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.721865:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c72e1ad/0x576b7af90af47ab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.721871:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c72e1ad/0x576b7af90af47ab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.721938:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.721950:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.721955:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c72e1ad/0x576b7af90af47ab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.721963:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476e00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.721968:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c72e1ad/0x576b7af90af47ab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.721977:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c72e1ad/0x576b7af90af47ab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.721990:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c72e1ad/0x576b7af90af47ab5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.721997:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c72e1ad/0x576b7af90af47ab5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.722012:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.722018:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.722020:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.723495:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.723507:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af47abc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.723523:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.723527:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.723534:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af47abc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.723547:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af47abc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.723695:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af47abc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.723706:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af47abc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.723732:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.723745:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.723751:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af47abc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.723759:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476000 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.723765:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af47abc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.723787:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af47abc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.723805:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af47abc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.723813:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054863cd7/0x576b7af90af47abc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.723831:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.723833:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.723835:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.724504:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.724512:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cbe6967/0x576b7af90af47ac3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.724522:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.724526:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.724530:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cbe6967/0x576b7af90af47ac3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.724539:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cbe6967/0x576b7af90af47ac3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.724547:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cbe6967/0x576b7af90af47ac3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.724562:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cbe6967/0x576b7af90af47ac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.724576:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.724587:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.724591:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cbe6967/0x576b7af90af47ac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.724598:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476a00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.724601:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cbe6967/0x576b7af90af47ac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.724608:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cbe6967/0x576b7af90af47ac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.724620:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cbe6967/0x576b7af90af47ac3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.724626:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cbe6967/0x576b7af90af47ac3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.724640:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.724642:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.724644:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.725295:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.725306:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d522bfd/0x576b7af90af47aca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.725315:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.725318:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.725320:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d522bfd/0x576b7af90af47aca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.725337:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d522bfd/0x576b7af90af47aca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.725343:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d522bfd/0x576b7af90af47aca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.725348:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d522bfd/0x576b7af90af47aca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.725357:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.725362:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.725365:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d522bfd/0x576b7af90af47aca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.725374:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477000 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.725377:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d522bfd/0x576b7af90af47aca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.725386:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d522bfd/0x576b7af90af47aca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.725405:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d522bfd/0x576b7af90af47aca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.725419:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d522bfd/0x576b7af90af47aca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.725435:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.725437:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.725439:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.726097:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.726105:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b01f20/0x576b7af90af47ad1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726122:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.726125:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.726130:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b01f20/0x576b7af90af47ad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726139:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b01f20/0x576b7af90af47ad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726155:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b01f20/0x576b7af90af47ad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726163:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b01f20/0x576b7af90af47ad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726193:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.726203:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.726206:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b01f20/0x576b7af90af47ad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726212:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477c00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.726220:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b01f20/0x576b7af90af47ad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726228:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b01f20/0x576b7af90af47ad1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726239:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b01f20/0x576b7af90af47ad1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726249:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b01f20/0x576b7af90af47ad1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726262:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.726264:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.726265:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.726549:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.726820:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.726827:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee31f716/0x576b7af90af47ad8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726837:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.726847:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.726852:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee31f716/0x576b7af90af47ad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726862:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee31f716/0x576b7af90af47ad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726870:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee31f716/0x576b7af90af47ad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602606.726921:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787602606.726929:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a384459/0x576b7af90af47adf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.726940:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1787602606.726944:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602606.726948:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a384459/0x576b7af90af47adf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726964:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee31f716/0x576b7af90af47ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.726994:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.726996:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a384459/0x576b7af90af47adf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727004:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602606.727008:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a384459/0x576b7af90af47adf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727010:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee31f716/0x576b7af90af47ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.727030:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a384459/0x576b7af90af47adf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727031:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.727062:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee31f716/0x576b7af90af47ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727071:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee31f716/0x576b7af90af47ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727091:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee31f716/0x576b7af90af47ad8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727111:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee31f716/0x576b7af90af47ad8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727127:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.727129:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.727131:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.727323:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.727331:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602606.727336:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a384459/0x576b7af90af47adf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.727344:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71e00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602606.727348:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a384459/0x576b7af90af47adf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.727357:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a384459/0x576b7af90af47adf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.727370:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a384459/0x576b7af90af47adf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.727378:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a384459/0x576b7af90af47adf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.727402:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.727404:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.727407:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.727707:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.727713:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8d3f0a1/0x576b7af90af47ae6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727722:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.727725:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.727730:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d3f0a1/0x576b7af90af47ae6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727739:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8d3f0a1/0x576b7af90af47ae6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727747:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8d3f0a1/0x576b7af90af47ae6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727755:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8d3f0a1/0x576b7af90af47ae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727768:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.727776:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.727784:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8d3f0a1/0x576b7af90af47ae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727791:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.727795:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8d3f0a1/0x576b7af90af47ae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727804:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8d3f0a1/0x576b7af90af47ae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727815:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8d3f0a1/0x576b7af90af47ae6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727823:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8d3f0a1/0x576b7af90af47ae6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.727837:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.727839:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.727841:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.728525:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.728532:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d56c4311/0x576b7af90af47aed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.728543:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.728547:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.728552:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d56c4311/0x576b7af90af47aed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.728574:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d56c4311/0x576b7af90af47aed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.728584:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d56c4311/0x576b7af90af47aed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.728591:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d56c4311/0x576b7af90af47aed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.728616:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.728919:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602606.728925:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d56c4311/0x576b7af90af47aed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.728935:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41477e00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602606.728940:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d56c4311/0x576b7af90af47aed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.728958:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d56c4311/0x576b7af90af47aed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.728978:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d56c4311/0x576b7af90af47aed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.728986:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d56c4311/0x576b7af90af47aed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.729010:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.729012:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.729015:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.729169:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.729176:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47af4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.729185:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.729188:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.729193:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47af4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.729202:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47af4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602606.729205:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.729216:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47af4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.729217:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074803dc1/0x576b7af90af47afb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.729261:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.729262:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47af4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.729267:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602606.729276:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074803dc1/0x576b7af90af47afb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.729286:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.729289:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074803dc1/0x576b7af90af47afb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.729296:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602606.729300:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074803dc1/0x576b7af90af47afb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.729303:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47af4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.729317:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074803dc1/0x576b7af90af47afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.729319:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.729324:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47af4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.729336:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47af4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.729338:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.729350:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.729354:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47af4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.729363:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf034e79/0x576b7af90af47af4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.729380:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.729383:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.729386:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787602606.730233:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:2.0:1787602606.730236:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787602606.730244:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afabe556/0x576b7af90af47b02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730248:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae1bdb54/0x576b7af90af47b09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.730268:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.730268:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.730272:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602606.730276:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.730277:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae1bdb54/0x576b7af90af47b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.730284:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afabe556/0x576b7af90af47b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730287:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae1bdb54/0x576b7af90af47b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730305:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae1bdb54/0x576b7af90af47b09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.730309:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afabe556/0x576b7af90af47b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730312:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae1bdb54/0x576b7af90af47b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730326:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.730328:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afabe556/0x576b7af90af47b02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.730338:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afabe556/0x576b7af90af47b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730339:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.730346:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae1bdb54/0x576b7af90af47b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.730351:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.730359:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41476800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.730364:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae1bdb54/0x576b7af90af47b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730373:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae1bdb54/0x576b7af90af47b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730395:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae1bdb54/0x576b7af90af47b09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730404:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae1bdb54/0x576b7af90af47b09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730426:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.730430:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afabe556/0x576b7af90af47b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730437:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70000 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.730441:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afabe556/0x576b7af90af47b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730449:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afabe556/0x576b7af90af47b02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730461:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afabe556/0x576b7af90af47b02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730469:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afabe556/0x576b7af90af47b02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.730483:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.730485:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.730491:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.731076:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.731082:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b4bc82/0x576b7af90af47b10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731089:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.731092:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.731096:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055b4bc82/0x576b7af90af47b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731103:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055b4bc82/0x576b7af90af47b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731108:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b4bc82/0x576b7af90af47b10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731113:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055b4bc82/0x576b7af90af47b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731122:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.731128:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.731130:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055b4bc82/0x576b7af90af47b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731134:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610b800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.731137:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b4bc82/0x576b7af90af47b10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731151:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b4bc82/0x576b7af90af47b10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731161:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055b4bc82/0x576b7af90af47b10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731166:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055b4bc82/0x576b7af90af47b10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731178:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.731180:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.731182:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.731520:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.731525:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000229de8a7/0x576b7af90af47b17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731532:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.731534:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.731537:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000229de8a7/0x576b7af90af47b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731543:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000229de8a7/0x576b7af90af47b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731548:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000229de8a7/0x576b7af90af47b17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731557:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000229de8a7/0x576b7af90af47b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731668:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.731680:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.731684:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000229de8a7/0x576b7af90af47b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731692:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610bc00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.731696:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000229de8a7/0x576b7af90af47b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731704:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000229de8a7/0x576b7af90af47b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731717:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000229de8a7/0x576b7af90af47b17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731724:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000229de8a7/0x576b7af90af47b17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.731739:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.731741:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.731748:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.733331:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.733356:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e073c1a/0x576b7af90af47b1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.733375:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.733380:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.733387:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e073c1a/0x576b7af90af47b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.733401:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e073c1a/0x576b7af90af47b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.733413:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e073c1a/0x576b7af90af47b1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.733421:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e073c1a/0x576b7af90af47b1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.733447:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.733462:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.733467:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e073c1a/0x576b7af90af47b1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.733476:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610b600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.733481:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e073c1a/0x576b7af90af47b1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.733490:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e073c1a/0x576b7af90af47b1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.733516:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e073c1a/0x576b7af90af47b1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.733524:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e073c1a/0x576b7af90af47b1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.733543:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.733546:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.733548:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.734186:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.734194:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47b25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734205:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.734208:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.734212:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47b25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734223:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47b25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734233:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47b25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734241:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734269:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602606.734279:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.734283:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734290:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610a800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.734295:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47b25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734303:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47b25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734317:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47b25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734326:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47b25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734342:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.734345:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.734347:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787602606.734543:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787602606.734552:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b76aa85/0x576b7af90af47b2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.734562:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1787602606.734566:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602606.734571:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b76aa85/0x576b7af90af47b2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.734582:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b76aa85/0x576b7af90af47b2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.734589:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b76aa85/0x576b7af90af47b2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.734596:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b76aa85/0x576b7af90af47b2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.734624:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.734634:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602606.734638:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b76aa85/0x576b7af90af47b2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.734646:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d70200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602606.734649:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b76aa85/0x576b7af90af47b2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.734656:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b76aa85/0x576b7af90af47b2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.734668:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b76aa85/0x576b7af90af47b2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.734676:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b76aa85/0x576b7af90af47b2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.734689:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.734691:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.734693:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.734857:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.734864:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a62662/0x576b7af90af47b33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734949:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.734960:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.734965:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a62662/0x576b7af90af47b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734977:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a62662/0x576b7af90af47b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734986:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a62662/0x576b7af90af47b33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.734993:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059a62662/0x576b7af90af47b33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.735011:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.735334:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602606.735340:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059a62662/0x576b7af90af47b33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.735348:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610b400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602606.735359:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a62662/0x576b7af90af47b33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.735368:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a62662/0x576b7af90af47b33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.735383:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059a62662/0x576b7af90af47b33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.735390:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a62662/0x576b7af90af47b33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.735412:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.735415:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.735417:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.735471:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.735478:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000711380cf/0x576b7af90af47b3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.735487:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.735490:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.735495:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000711380cf/0x576b7af90af47b3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.735504:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000711380cf/0x576b7af90af47b3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.735514:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000711380cf/0x576b7af90af47b3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.735529:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000711380cf/0x576b7af90af47b3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.735552:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.735556:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602606.735563:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000711380cf/0x576b7af90af47b3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.735572:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610ba00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602606.735576:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000711380cf/0x576b7af90af47b3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.735585:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000711380cf/0x576b7af90af47b3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.735597:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000711380cf/0x576b7af90af47b3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.735611:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000711380cf/0x576b7af90af47b3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.735630:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.735633:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.735636:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.736103:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.736109:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca8fffa/0x576b7af90af47b41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.736118:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.736121:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.736125:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca8fffa/0x576b7af90af47b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.736133:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca8fffa/0x576b7af90af47b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.736140:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca8fffa/0x576b7af90af47b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.736146:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ca8fffa/0x576b7af90af47b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.736167:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.736172:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602606.736179:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ca8fffa/0x576b7af90af47b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.736188:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610aa00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602606.736192:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca8fffa/0x576b7af90af47b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.736201:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca8fffa/0x576b7af90af47b41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.736215:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ca8fffa/0x576b7af90af47b41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.736223:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca8fffa/0x576b7af90af47b41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.736243:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.736246:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.736247:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.736714:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.736720:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47b48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.736735:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.736738:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.736743:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47b48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.736753:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47b48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.736762:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47b48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.736769:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47b48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.736787:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602606.736910:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602606.736916:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47b48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.736924:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610a600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602606.736928:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47b48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.736937:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47b48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.737277:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47b48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.737288:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47b48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602606.737302:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787602606.737305:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.737309:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.737309:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d06c6a2/0x576b7af90af47b4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.737311:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.737321:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.737324:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.737328:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d06c6a2/0x576b7af90af47b4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.737337:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d06c6a2/0x576b7af90af47b4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.737360:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d06c6a2/0x576b7af90af47b4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.737368:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d06c6a2/0x576b7af90af47b4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.737382:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602606.737862:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.737868:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47b56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.737948:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.737951:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.737956:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47b56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.737965:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47b56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.737973:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47b56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.737980:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47b56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.738000:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787602606.740176:0:15844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602606.740196:0:15844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d06c6a2/0x576b7af90af47b4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.740210:0:15844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610ae00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.740216:0:15844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d06c6a2/0x576b7af90af47b4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.740227:0:15844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d06c6a2/0x576b7af90af47b4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.740253:0:15844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d06c6a2/0x576b7af90af47b4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.740261:0:15844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d06c6a2/0x576b7af90af47b4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.740284:0:15844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.740288:0:15844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47b56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.740295:0:15844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610ac00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.740298:0:15844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47b56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.740320:0:15844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47b56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.740331:0:15844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47b56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.740339:0:15844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47b56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.740363:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.740365:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.740373:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.740549:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074803dc1/0x576b7af90af47afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.740561:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.740564:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074803dc1/0x576b7af90af47afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.740573:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074803dc1/0x576b7af90af47afb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.740592:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074803dc1/0x576b7af90af47afb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.740600:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074803dc1/0x576b7af90af47afb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.740647:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.740650:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.740652:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.740978:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787602606.742740:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602606.742763:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab31f87/0x576b7af90af47b64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.742799:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787602606.742805:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602606.742813:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dab31f87/0x576b7af90af47b64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.742830:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dab31f87/0x576b7af90af47b64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.742842:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab31f87/0x576b7af90af47b64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.742850:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dab31f87/0x576b7af90af47b64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.742873:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787602606.743502:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602606.743510:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aa62a97/0x576b7af90af47b6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.743520:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787602606.743523:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602606.743528:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aa62a97/0x576b7af90af47b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.743538:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aa62a97/0x576b7af90af47b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.743558:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aa62a97/0x576b7af90af47b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.743565:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aa62a97/0x576b7af90af47b6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.743581:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787602606.743593:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602606.743600:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dab31f87/0x576b7af90af47b64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.743608:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458c00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.743614:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab31f87/0x576b7af90af47b64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.743624:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab31f87/0x576b7af90af47b64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.743643:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dab31f87/0x576b7af90af47b64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.743650:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dab31f87/0x576b7af90af47b64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602606.743698:0:15063:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787602606.743708:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd7ed78/0x576b7af90af47b5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743718:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1787602606.743721:0:15063:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602606.743725:0:15063:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd7ed78/0x576b7af90af47b5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743746:0:15063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfd7ed78/0x576b7af90af47b5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743756:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd7ed78/0x576b7af90af47b5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743763:0:15063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd7ed78/0x576b7af90af47b5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743779:0:15063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787602606.743789:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787602606.743794:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aa62a97/0x576b7af90af47b6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743801:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459c00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602606.743805:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aa62a97/0x576b7af90af47b6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743813:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aa62a97/0x576b7af90af47b6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743825:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aa62a97/0x576b7af90af47b6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743832:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aa62a97/0x576b7af90af47b6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743858:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602606.743861:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfd7ed78/0x576b7af90af47b5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743868:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71c00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602606.743871:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd7ed78/0x576b7af90af47b5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743879:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd7ed78/0x576b7af90af47b5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743900:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfd7ed78/0x576b7af90af47b5d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743909:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfd7ed78/0x576b7af90af47b5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.743925:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.743927:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602606.743928:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787602606.744189:0:15063:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1787602606.744308:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14401:x1874436839010304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 42423us (42487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602606.744319:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602606.744391:0:14401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14401:1874436839010304:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787602606.744417:0:14401:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787602606.744551:0:14401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14401:1874436839010688:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787602606.744595:0:14401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602606.744643:0:14401:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d329600 going to sleep for 11 seconds 00000100:00100000:3.0:1787602606.744664:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839010688 00000100:00100000:3.0:1787602606.744671:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839010688 00000100:00100000:3.0:1787602606.744718:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787602606.744729:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14401:x1874436839010688:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787602606.744785:0:15064:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1787602606.747242:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.747253:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.747255:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787602606.748396:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602606.748407:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb46501a/0x576b7af90af47b72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.748427:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787602606.748432:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602606.748438:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb46501a/0x576b7af90af47b72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.748455:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb46501a/0x576b7af90af47b72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.748467:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb46501a/0x576b7af90af47b72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.748474:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb46501a/0x576b7af90af47b72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.748495:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787602606.748924:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602606.748931:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c8813fc/0x576b7af90af47b79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.748939:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787602606.748942:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602606.748946:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c8813fc/0x576b7af90af47b79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.748962:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c8813fc/0x576b7af90af47b79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.748970:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c8813fc/0x576b7af90af47b79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.748977:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c8813fc/0x576b7af90af47b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.748993:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787602606.749421:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602606.749428:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc518cae/0x576b7af90af47b80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.749437:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787602606.749440:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602606.749444:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc518cae/0x576b7af90af47b80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.749453:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc518cae/0x576b7af90af47b80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.749462:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc518cae/0x576b7af90af47b80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.749482:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc518cae/0x576b7af90af47b80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.749491:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787602606.749939:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602606.749946:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af47b87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.749954:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787602606.749958:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602606.749962:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af47b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.749971:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af47b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.749979:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af47b87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.749986:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af47b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.749994:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787602606.750980:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602606.750991:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b481ed/0x576b7af90af47b8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.751009:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1787602606.751013:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602606.751018:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b481ed/0x576b7af90af47b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.751029:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b481ed/0x576b7af90af47b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787602606.751117:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787602606.751164:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787602606.751173:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb46501a/0x576b7af90af47b72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751182:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.751187:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb46501a/0x576b7af90af47b72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751197:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb46501a/0x576b7af90af47b72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751229:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb46501a/0x576b7af90af47b72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751252:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb46501a/0x576b7af90af47b72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751290:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787602606.751294:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c8813fc/0x576b7af90af47b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751301:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459a00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.751306:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c8813fc/0x576b7af90af47b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751315:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c8813fc/0x576b7af90af47b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751329:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c8813fc/0x576b7af90af47b79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751337:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c8813fc/0x576b7af90af47b79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751353:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602606.751359:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc518cae/0x576b7af90af47b80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751366:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.751377:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc518cae/0x576b7af90af47b80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751388:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc518cae/0x576b7af90af47b80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751400:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc518cae/0x576b7af90af47b80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751407:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc518cae/0x576b7af90af47b80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751422:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.751426:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af47b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751433:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458e00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.751436:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af47b87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751444:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af47b87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751454:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af47b87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751461:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000591e0348/0x576b7af90af47b87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.751482:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.751484:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.751486:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.752232:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b481ed/0x576b7af90af47b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.752243:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b481ed/0x576b7af90af47b8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.752285:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.752309:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602606.753120:0:15844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602606.753128:0:15844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b481ed/0x576b7af90af47b8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.753137:0:15844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.753142:0:15844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b481ed/0x576b7af90af47b8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.753152:0:15844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b481ed/0x576b7af90af47b8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.753181:0:15844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b481ed/0x576b7af90af47b8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.753189:0:15844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b481ed/0x576b7af90af47b8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.753212:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.753215:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.753216:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.753589:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.754175:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.754185:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47b95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.754199:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.754204:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.754210:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.754223:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.754233:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.754240:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47b95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.754256:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602606.754779:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.754792:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47b9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.754812:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.754816:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.754821:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.754830:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.754838:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.754845:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47b9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.754859:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787602606.755309:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.755316:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47ba3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.755324:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.755328:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.755333:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47ba3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.755342:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47ba3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.755360:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47ba3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.755368:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47ba3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.755383:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787602606.755861:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.755868:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47baa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.755877:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.755881:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.755885:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.755903:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.755912:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47baa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.755919:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47baa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.755938:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787602606.756419:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.756425:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef5ce778/0x576b7af90af47bb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.756434:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.756437:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.756442:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef5ce778/0x576b7af90af47bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.756450:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef5ce778/0x576b7af90af47bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.756458:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef5ce778/0x576b7af90af47bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757638:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787602606.757650:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47b95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757663:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610b000 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.757668:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47b95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757681:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47b95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757704:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47b95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757711:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47b95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757753:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787602606.757758:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47b9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757764:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610b200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.757767:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47b9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757775:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757785:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47b9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757792:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47b9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757802:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602606.757806:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47ba3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757813:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610a000 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.757816:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47ba3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757836:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47ba3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757847:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47ba3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757854:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47ba3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757867:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602606.757871:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47baa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757878:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610a400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.757881:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47baa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757897:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47baa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757907:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47baa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757914:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47baa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.757939:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.757942:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.757944:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.757953:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602606.759485:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14401:x1874436839010688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14748us (14881us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787602606.759499:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787602606.759584:0:14401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3d9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14401:1874436839010688:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787602606.759605:0:14401:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787602606.760255:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef5ce778/0x576b7af90af47bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.760286:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602606.763053:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602606.763071:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef5ce778/0x576b7af90af47bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.763088:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610a200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.763094:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef5ce778/0x576b7af90af47bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.763106:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef5ce778/0x576b7af90af47bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602606.763119:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.763133:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef5ce778/0x576b7af90af47bb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.763141:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef5ce778/0x576b7af90af47bb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.763199:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.763201:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.763205:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.764156:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.764167:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a3eae1/0x576b7af90af47bb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.764181:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.764191:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.764199:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a3eae1/0x576b7af90af47bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.764214:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a3eae1/0x576b7af90af47bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.764224:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a3eae1/0x576b7af90af47bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.764232:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a3eae1/0x576b7af90af47bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.764257:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602606.764612:0:15844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602606.764619:0:15844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a3eae1/0x576b7af90af47bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.764628:0:15844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610a800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.764632:0:15844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a3eae1/0x576b7af90af47bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.764641:0:15844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a3eae1/0x576b7af90af47bb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.764658:0:15844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a3eae1/0x576b7af90af47bb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.764665:0:15844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a3eae1/0x576b7af90af47bb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.764688:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.764690:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.764693:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.765961:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.765971:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e073c1a/0x576b7af90af47bbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.765985:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.765989:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.765995:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e073c1a/0x576b7af90af47bbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.766007:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e073c1a/0x576b7af90af47bbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.766017:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e073c1a/0x576b7af90af47bbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.766031:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e073c1a/0x576b7af90af47bbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.766081:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602606.766654:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.766661:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000229de8a7/0x576b7af90af47bc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.766672:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.766675:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.766679:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000229de8a7/0x576b7af90af47bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.766689:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000229de8a7/0x576b7af90af47bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.766698:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000229de8a7/0x576b7af90af47bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.766706:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000229de8a7/0x576b7af90af47bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.766719:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787602606.767218:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602606.767226:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e073c1a/0x576b7af90af47bbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.767253:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610b600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.767263:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e073c1a/0x576b7af90af47bbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.767273:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e073c1a/0x576b7af90af47bbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.767291:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e073c1a/0x576b7af90af47bbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.767298:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e073c1a/0x576b7af90af47bbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.767318:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602606.767321:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000229de8a7/0x576b7af90af47bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.767328:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610bc00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.767330:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000229de8a7/0x576b7af90af47bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.767337:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000229de8a7/0x576b7af90af47bc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.767345:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000229de8a7/0x576b7af90af47bc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.767359:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000229de8a7/0x576b7af90af47bc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.767374:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.767376:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.767378:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.767626:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.767632:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055b4bc82/0x576b7af90af47bcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.767866:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.767871:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.767876:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055b4bc82/0x576b7af90af47bcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.767897:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055b4bc82/0x576b7af90af47bcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.767908:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055b4bc82/0x576b7af90af47bcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.767915:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055b4bc82/0x576b7af90af47bcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.767940:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602606.768527:0:15844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602606.768535:0:15844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055b4bc82/0x576b7af90af47bcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.768544:0:15844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610b800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.768549:0:15844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055b4bc82/0x576b7af90af47bcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.768557:0:15844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055b4bc82/0x576b7af90af47bcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.768573:0:15844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055b4bc82/0x576b7af90af47bcd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.768580:0:15844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055b4bc82/0x576b7af90af47bcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.768597:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.768598:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.768600:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.769433:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.769442:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f0bafc/0x576b7af90af47bd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.769454:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.769458:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.769464:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f0bafc/0x576b7af90af47bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.769476:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1f0bafc/0x576b7af90af47bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.769496:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f0bafc/0x576b7af90af47bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.769504:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f0bafc/0x576b7af90af47bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.769519:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602606.769987:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602606.769995:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1f0bafc/0x576b7af90af47bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.770005:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610be00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.770011:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f0bafc/0x576b7af90af47bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.770020:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f0bafc/0x576b7af90af47bd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.770057:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1f0bafc/0x576b7af90af47bd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.770065:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f0bafc/0x576b7af90af47bd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.770088:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.770090:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.770092:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.771572:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.771584:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4ce63b9/0x576b7af90af47bdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.771600:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.771604:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.771610:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4ce63b9/0x576b7af90af47bdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.771623:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4ce63b9/0x576b7af90af47bdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.771633:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4ce63b9/0x576b7af90af47bdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.771641:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4ce63b9/0x576b7af90af47bdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.771680:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602606.772189:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.772195:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d06c6a2/0x576b7af90af47be2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.772206:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.772209:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.772213:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d06c6a2/0x576b7af90af47be2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.772222:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d06c6a2/0x576b7af90af47be2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.772229:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d06c6a2/0x576b7af90af47be2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.772236:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d06c6a2/0x576b7af90af47be2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.772256:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787602606.772708:0:15844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602606.772731:0:15844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4ce63b9/0x576b7af90af47bdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.772746:0:15844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610ac00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.772752:0:15844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4ce63b9/0x576b7af90af47bdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.772779:0:15844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4ce63b9/0x576b7af90af47bdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.772798:0:15844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4ce63b9/0x576b7af90af47bdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.772806:0:15844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4ce63b9/0x576b7af90af47bdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.772827:0:15844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602606.772831:0:15844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d06c6a2/0x576b7af90af47be2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.772838:0:15844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610ae00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.772842:0:15844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d06c6a2/0x576b7af90af47be2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.772848:0:15844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d06c6a2/0x576b7af90af47be2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.772857:0:15844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d06c6a2/0x576b7af90af47be2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.772863:0:15844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d06c6a2/0x576b7af90af47be2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602606.772897:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.772899:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602606.772902:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602606.773565:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602606.773573:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.778540:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.778557:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47be9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.778579:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.778591:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.778599:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47be9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.778617:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47be9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.778630:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47be9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.778638:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47be9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.778665:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602606.779366:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.779374:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47bf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.779386:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.779389:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.779394:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.779405:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.779414:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.779427:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.779452:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787602606.779466:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787602606.779477:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47be9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602606.779488:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610a400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602606.779495:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47be9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602606.779507:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47be9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602606.779548:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47be9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602606.779556:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c78d0bde/0x576b7af90af47be9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602606.779582:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602606.779586:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602606.779595:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610a000 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602606.779596:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602606.779600:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602606.779610:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47bf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602606.779928:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47bf0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602606.779938:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be075b4c/0x576b7af90af47bf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602606.779956:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602606.779959:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602606.779976:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602606.785463:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.785481:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47bf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.785503:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.785509:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.785518:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.785535:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.785548:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.785557:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.785578:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602606.786660:0:15842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602606.786670:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47bfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.786750:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1787602606.786754:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602606.786762:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47bfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.786774:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47bfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.786783:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47bfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.786789:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47bfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.786814:0:15842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787602606.786833:0:15844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602606.786840:0:15844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.786849:0:15844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610b200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.786855:0:15844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.786865:0:15844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.786910:0:15844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47bf7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.786917:0:15844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000475e2304/0x576b7af90af47bf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.787008:0:15844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602606.787013:0:15844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47bfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.787021:0:15844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610b000 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602606.787025:0:15844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47bfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.787065:0:15844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47bfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.787079:0:15844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47bfe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.787087:0:15844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c76afb8/0x576b7af90af47bfe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602606.787109:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.787111:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602606.787120:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602606.787166:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787602606.787431:0:15842:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1787602606.787550:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14403:x1874436839010560:12345-0@lo:5:osp-pre-1-0.0 Request processed in 78321us (83246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602606.787563:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787602606.787645:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14403:1874436839010560:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787602606.787667:0:14403:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787602606.787813:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14403:1874436839010816:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787602606.787862:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602606.787927:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787602606.787955:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839010816 00000100:00100000:2.0:1787602606.787963:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839010816 00000100:00100000:2.0:1787602606.788016:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787602606.788028:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14403:x1874436839010816:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787602606.788100:0:15065:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787602606.794231:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14403:x1874436839010816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6195us (6359us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787602606.794247:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787602606.794319:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14403:1874436839010816:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787602606.794338:0:14403:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1787602606.816984:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787602606.817260:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787602607.710484:0:14375:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787602607.710494:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff944946355000 from 8 10000000:01000000:1.0:1787602607.710499:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787602607.710560:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011c400/0x576b7af90af47c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602607.710575:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a5011c400/0x576b7af90af47c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602607.710589:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a5011c400/0x576b7af90af47c05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602607.710623:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839010944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602607.710712:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602607.710779:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602607.710843:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839010944 00000100:00100000:3.0:1787602607.710853:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839010944 00000100:00100000:3.0:1787602607.710940:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787602607.710951:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:14375:x1874436839010944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602607.710968:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602607.710984:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d71c00/0x576b7af90af47c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47c05 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602607.711012:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71c00/0x576b7af90af47c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47c05 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602607.711023:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d71c00/0x576b7af90af47c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47c05 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602607.711034:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71c00, rc 0) 00000100:00100000:3.0:1787602607.711102:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:14375:x1874436839010944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602607.711124:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787602607.711517:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839010944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602607.711539:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a5011c400/0x576b7af90af47c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47c0c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602607.711550:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a5011c400/0x576b7af90af47c05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47c0c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602607.711615:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839011072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787602607.711659:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602607.711695:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489b29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602607.712715:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839011072 00000100:00100000:3.0:1787602607.712727:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839011072 00000100:00100000:3.0:1787602607.712789:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787602607.712799:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:14375:x1874436839011072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787602607.712824:0:14371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787602607.712845:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787602607.712848:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787602607.712995:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:14375:x1874436839011072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 197us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602607.713004:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787602607.713127:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839011072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787602607.713215:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787602607.713227:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a5011c400/0x576b7af90af47c05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47c0c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602607.713239:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a5011c400/0x576b7af90af47c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47c0c expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602607.850115:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602608.864971:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787602609.300503:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787602609.300576:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1787602609.889079:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602610.909263:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787602611.319246:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787602611.319278:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:1.0:1787602611.602543:0:16138:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg625-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787602611.741353:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a4d3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436839011200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602611.741422:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602611.741493:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839011200 00000100:00100000:3.0:1787602611.741501:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839011200 00000100:00100000:3.0:1787602611.741549:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602611.741558:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436839011200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602611.741588:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602611.741631:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874436839011200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602611.741639:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787602611.741659:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602611.741686:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787602611.741710:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a4d3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874436839011200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602611.741892:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436839011456:0@lo:400:kworker.0 00000100:00100000:1.0:1787602611.741923:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602611.741941:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787602611.741946:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3314:1874436839011328:0@lo:400:kworker.0 00000100:00100000:1.0:1787602611.741968:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602611.741987:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436839011840:0@lo:400:kworker.0 00000100:00100000:1.0:1787602611.742005:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602611.742026:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839011328 00000100:00100000:1.0:1787602611.742029:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839011328 00000100:00100000:1.0:1787602611.742078:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787602611.742084:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:3314:x1874436839011328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602611.742130:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:3314:x1874436839011328:12345-0@lo:400:kworker.0 Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602611.742137:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787602611.742168:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3314:1874436839011328:0@lo:400:kworker.0 00000100:00100000:3.0:1787602611.742284:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436839011712:0@lo:400:kworker.0 00000100:00100000:3.0:1787602611.742309:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602611.742332:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602611.742337:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436839011584:0@lo:400:kworker.0 00000100:00100000:3.0:1787602611.742357:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602611.742386:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839011840 00000100:00100000:3.0:1787602611.742390:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839011840 00000100:00100000:3.0:1787602611.742416:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839011712 00000100:00100000:3.0:1787602611.742419:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839011712 00000100:00100000:3.0:1787602611.742430:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839011584 00000100:00100000:3.0:1787602611.742433:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839011584 00000100:00100000:3.0:1787602611.742444:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602611.742450:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436839011840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602611.742486:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874436839011840:12345-0@lo:400:kworker.0 Request processed in 36us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602611.742493:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602611.742505:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787602611.742510:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436839011712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602611.742538:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436839011712:12345-0@lo:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602611.742544:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787602611.742555:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787602611.742561:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436839011584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602611.742587:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874436839011584:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602611.742601:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787602611.742626:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787602611.742648:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c834700 x1874436839011840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602611.742660:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874436839011840:0@lo:400:kworker.0 00010000:00080000:3.0:1787602611.742682:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c835c00 x1874436839011584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602611.742690:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874436839011584:0@lo:400:kworker.0 00010000:00080000:3.0:1787602611.742699:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff944a7c835f80 x1874436839011712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602611.742706:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436839011712:0@lo:400:kworker.0 00000100:00100000:0.0:1787602611.742847:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839011456 00000100:00100000:0.0:1787602611.742852:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839011456 00000100:00100000:0.0:1787602611.742901:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602611.742909:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436839011456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602611.742949:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436839011456:12345-0@lo:400:kworker.0 Request processed in 42us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602611.742955:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787602611.743090:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602611.743109:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9449481c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436839011968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602611.743134:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602611.743155:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787602611.743164:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436839011456:0@lo:400:kworker.0 00000100:00100000:3.0:1787602611.744204:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839011968 00000100:00100000:3.0:1787602611.744213:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839011968 00000100:00100000:3.0:1787602611.744300:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602611.744309:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436839011968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602611.744338:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602611.744403:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436839011968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602611.744409:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602611.745875:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9449481c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436839011968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787602611.935940:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602612.958792:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787602613.341704:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787602613.529085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602613.529169:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821195264 00000100:00100000:3.0:1787602613.529177:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821195264 00000100:00100000:3.0:1787602613.529213:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 75 00000100:00100000:3.0:1787602613.529221:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1874436821195264:12345-192.168.206.25@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787602613.529248:0:14372:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f4ea071c-5555-42cd-ad4f-55bb895c26a4@192.168.206.25@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:3.0:1787602613.529288:0:14372:0:(genops.c:1385:class_connect()) connect: client f4ea071c-5555-42cd-ad4f-55bb895c26a4, cookie 0x576b7af90af47c13 00000100:00080000:3.0:1787602613.529412:0:14372:0:(import.c:65:import_set_state_nolock()) ffff944a48ee5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602613.529483:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+5:2360:x1874436821195264:12345-192.168.206.25@tcp:250:mount.lustre.0 Request processed in 261us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602613.529491:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 75 00000100:00100000:3.0:1787602613.533126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602613.533468:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821195392 00000100:00100000:0.0:1787602613.533477:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821195392 00000100:00100000:0.0:1787602613.533526:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 76 00000100:00100000:0.0:1787602613.533537:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+5:13745:x1874436821195392:12345-192.168.206.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787602613.533553:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602613.533570:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a7c459800/0x576b7af90af47c1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235010e expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602613.533619:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a7c459800/0x576b7af90af47c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235010e expref: 6 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602613.533630:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a7c459800/0x576b7af90af47c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235010e expref: 6 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602613.533638:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459800, rc 0) 00000100:00100000:0.0:1787602613.533700:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+6:13745:x1874436821195392:12345-192.168.206.25@tcp:101:mount.lustre.0 Request processed in 163us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602613.533706:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 76 00000100:00100000:2.0:1787602613.541478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602613.541584:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821195520 00000100:00100000:1.0:1787602613.541593:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821195520 00000100:00100000:1.0:1787602613.541666:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 77 00000100:00100000:1.0:1787602613.541676:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+6:13745:x1874436821195520:12345-192.168.206.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787602613.542246:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+6:13745:x1874436821195520:12345-192.168.206.25@tcp:501:mount.lustre.0 Request processed in 569us (775us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602613.542256:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 77 00000100:00100000:2.0:1787602613.546196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602613.547164:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821195648 00000100:00100000:3.0:1787602613.547181:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821195648 00000100:00100000:3.0:1787602613.547333:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 78 00000100:00100000:3.0:1787602613.547346:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+6:13745:x1874436821195648:12345-192.168.206.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787602613.547591:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602613.547616:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70200/0x576b7af90af47c21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350115 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.547656:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70200/0x576b7af90af47c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350115 expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.547680:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70200/0x576b7af90af47c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350115 expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.547691:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70200, rc 0) 00000100:00100000:3.0:1787602613.548138:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+7:13745:x1874436821195648:12345-192.168.206.25@tcp:101:mount.lustre.0 Request processed in 792us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602613.548147:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 78 00000100:00100000:2.0:1787602613.553234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602613.553430:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821195776 00000100:00100000:1.0:1787602613.553444:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821195776 00000100:00100000:1.0:1787602613.553670:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 79 00000100:00100000:1.0:1787602613.553682:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+7:13745:x1874436821195776:12345-192.168.206.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787602613.554297:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+8:13745:x1874436821195776:12345-192.168.206.25@tcp:501:mount.lustre.0 Request processed in 612us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602613.554308:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 79 00000100:00100000:2.0:1787602613.558228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602613.558969:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821195904 00000100:00100000:0.0:1787602613.558982:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821195904 00000100:00100000:0.0:1787602613.559292:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 80 00000100:00100000:0.0:1787602613.559305:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+8:13745:x1874436821195904:12345-192.168.206.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787602613.560202:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+8:13745:x1874436821195904:12345-192.168.206.25@tcp:503:mount.lustre.0 Request processed in 895us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602613.560214:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 80 00000100:00100000:2.0:1787602613.570468:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602613.570586:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821196032 00000100:00100000:1.0:1787602613.570600:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821196032 00000100:00100000:1.0:1787602613.570668:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 81 00000100:00100000:1.0:1787602613.570681:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+8:13763:x1874436821196032:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787602613.571196:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+8:13763:x1874436821196032:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 514us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602613.571205:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 81 00000100:00100000:0.0:1787602613.595026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602613.595901:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821196160 00000100:00100000:1.0:1787602613.595917:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821196160 00000100:00100000:1.0:1787602613.596079:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 82 00000100:00100000:1.0:1787602613.596093:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+8:13763:x1874436821196160:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787602613.596911:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+8:13763:x1874436821196160:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 816us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602613.596923:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 82 00000100:00100000:2.0:1787602613.603462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602613.606699:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821196288 00000100:00100000:3.0:1787602613.606725:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821196288 00000100:00100000:3.0:1787602613.606889:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 83 00000100:00100000:3.0:1787602613.606903:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+8:13745:x1874436821196288:12345-192.168.206.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787602613.606944:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602613.606968:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d71e00/0x576b7af90af47c28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235013f expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.607014:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71e00/0x576b7af90af47c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235013f expref: 9 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.607027:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d71e00/0x576b7af90af47c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235013f expref: 9 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.607087:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71e00, rc 0) 00000100:00100000:3.0:1787602613.607178:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+9:13745:x1874436821196288:12345-192.168.206.25@tcp:101:mount.lustre.0 Request processed in 278us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602613.607186:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 83 00000100:00100000:2.0:1787602613.612453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602613.612686:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821196416 00000100:00100000:1.0:1787602613.612699:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821196416 00000100:00100000:1.0:1787602613.612893:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 84 00000100:00100000:1.0:1787602613.612906:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e566c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+9:13745:x1874436821196416:12345-192.168.206.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787602613.612939:0:14371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787602613.612969:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787602613.612974:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787602613.612977:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787602613.612979:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787602613.616127:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e566c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+9:13745:x1874436821196416:12345-192.168.206.25@tcp:256:mount.lustre.0 Request processed in 3209us (3673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602613.616146:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 84 00000100:00100000:3.0:1787602613.618879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602613.619152:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821196544 00000100:00100000:0.0:1787602613.619166:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821196544 00000100:00100000:0.0:1787602613.619286:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 85 00000100:00100000:0.0:1787602613.619298:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+9:13745:x1874436821196544:12345-192.168.206.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787602613.619321:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602613.619343:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a7c458000/0x576b7af90af47c2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350146 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602613.619425:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a7c458000/0x576b7af90af47c2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350146 expref: 10 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602613.619439:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a7c458000/0x576b7af90af47c2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350146 expref: 10 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602613.619450:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c458000, rc 0) 00000100:00100000:0.0:1787602613.619527:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+10:13745:x1874436821196544:12345-192.168.206.25@tcp:101:mount.lustre.0 Request processed in 231us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602613.619535:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 85 00000100:00100000:2.0:1787602613.622253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602613.622341:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821196672 00000100:00100000:1.0:1787602613.622363:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821196672 00000100:00100000:1.0:1787602613.622430:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 86 00000100:00100000:1.0:1787602613.622441:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+10:13745:x1874436821196672:12345-192.168.206.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787602613.622970:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+10:13745:x1874436821196672:12345-192.168.206.25@tcp:501:mount.lustre.0 Request processed in 528us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602613.622983:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 86 00000100:00100000:3.0:1787602613.625967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602613.626097:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821196800 00000100:00100000:0.0:1787602613.626109:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821196800 00000100:00100000:0.0:1787602613.626212:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 87 00000100:00100000:0.0:1787602613.626225:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+10:13745:x1874436821196800:12345-192.168.206.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787602613.626779:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+10:13745:x1874436821196800:12345-192.168.206.25@tcp:503:mount.lustre.0 Request processed in 555us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602613.626788:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 87 00000100:00100000:0.0:1787602613.629626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602613.629768:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821196928 00000100:00100000:2.0:1787602613.629780:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821196928 00000100:00100000:2.0:1787602613.629844:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 88 00000100:00100000:2.0:1787602613.629866:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+10:13768:x1874436821196928:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787602613.630291:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+10:13768:x1874436821196928:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 425us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602613.630301:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 88 00000100:00100000:2.0:1787602613.632767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602613.632875:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821197056 00000100:00100000:0.0:1787602613.632887:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821197056 00000100:00100000:0.0:1787602613.632952:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 89 00000100:00100000:0.0:1787602613.632964:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+10:13768:x1874436821197056:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602613.633985:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+10:13768:x1874436821197056:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 1016us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602613.633998:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 89 00000100:00100000:3.0:1787602613.642018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602613.642191:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821197184 00000100:00100000:0.0:1787602613.642205:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821197184 00000100:00100000:0.0:1787602613.642263:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:0.0:1787602613.642273:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1874436821197184:12345-192.168.206.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787602613.642310:0:14379:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4d743acf-bd40-44c9-89fb-11535243145c@192.168.206.25@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1787602613.642378:0:14379:0:(genops.c:1385:class_connect()) connect: client 4d743acf-bd40-44c9-89fb-11535243145c, cookie 0x576b7af90af47c36 00000004:00100000:0.0:1787602613.642418:0:14379:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787602613.642426:0:14379:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787602613.678331:0:14379:0:(import.c:65:import_set_state_nolock()) ffff944a68e80000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787602613.678482:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+6:2360:x1874436821197184:12345-192.168.206.25@tcp:38:mount.lustre.0 Request processed in 36207us (36477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602613.678496:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:2.0:1787602613.681577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602613.681624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602613.682270:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821197312 00000100:00100000:3.0:1787602613.682284:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821197312 00000100:00080000:0.0:1787602613.682444:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602613.682545:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821197440 00000100:00100000:3.0:1787602613.682549:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821197440 00000100:00100000:3.0:1787602613.682574:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:3.0:1787602613.682586:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+7:0:x1874436821197312:12345-192.168.206.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787602613.682644:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787602613.685378:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+7:0:x1874436821197312:12345-192.168.206.25@tcp:41:mount.lustre.0 Request processed in 2784us (3806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602613.685391:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:3.0:1787602613.685442:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:3.0:1787602613.685453:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+6:13745:x1874436821197440:12345-192.168.206.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787602613.685620:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787602613.685649:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+6:13745:x1874436821197440:12345-192.168.206.25@tcp:41:mount.lustre.0 Request processed in 200us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602613.685656:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:2.0:1787602613.689326:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602613.689476:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821197568 00000100:00100000:1.0:1787602613.689486:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821197568 00000100:00100000:1.0:1787602613.689543:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:1.0:1787602613.689554:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+6:13745:x1874436821197568:12345-192.168.206.25@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787602613.689710:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+6:13745:x1874436821197568:12345-192.168.206.25@tcp:40:mount.lustre.0 Request processed in 157us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602613.689718:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:0.0:1787602613.693134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602613.693213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602613.693369:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821197696 00000100:00100000:2.0:1787602613.693379:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821197696 00000100:00100000:2.0:1787602613.693419:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:2.0:1787602613.693427:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1874436821197696:12345-192.168.206.25@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787602613.693454:0:15063:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4d743acf-bd40-44c9-89fb-11535243145c@192.168.206.25@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:2.0:1787602613.693482:0:15063:0:(genops.c:1385:class_connect()) connect: client 4d743acf-bd40-44c9-89fb-11535243145c, cookie 0x576b7af90af47c3d 00002000:00100000:2.0:1787602613.693493:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4d743acf-bd40-44c9-89fb-11535243145c/ffff944947816800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787602613.693520:0:15063:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787602613.693835:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787602613.693890:0:15063:0:(import.c:65:import_set_state_nolock()) ffff944947814800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602613.693950:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d743acf-bd40-44c9-89fb-11535243145c+6:2360:x1874436821197696:12345-192.168.206.25@tcp:8:mount.lustre.0 Request processed in 521us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602613.693958:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:1.0:1787602613.694237:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821197952 00000100:00100000:1.0:1787602613.694243:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821197952 00000100:00100000:1.0:1787602613.694288:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:1.0:1787602613.694296:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d743acf-bd40-44c9-89fb-11535243145c+6:13745:x1874436821197952:12345-192.168.206.25@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787602613.696548:0:14381:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2201us 00000100:00100000:0.0:1787602613.698118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602613.699767:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821197824 00000100:00100000:1.0:1787602613.699779:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821197824 00000100:00100000:1.0:1787602613.699830:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:1.0:1787602613.699838:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874436821197824:12345-192.168.206.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787602613.699877:0:15064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4d743acf-bd40-44c9-89fb-11535243145c@192.168.206.25@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:1.0:1787602613.699905:0:15064:0:(genops.c:1385:class_connect()) connect: client 4d743acf-bd40-44c9-89fb-11535243145c, cookie 0x576b7af90af47c44 00002000:00100000:1.0:1787602613.699917:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4d743acf-bd40-44c9-89fb-11535243145c/ffff944946361800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602613.699939:0:15064:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602613.700253:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787602613.700280:0:15064:0:(import.c:65:import_set_state_nolock()) ffff944946367800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602613.700333:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d743acf-bd40-44c9-89fb-11535243145c+6:2360:x1874436821197824:12345-192.168.206.25@tcp:8:mount.lustre.0 Request processed in 495us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602613.700340:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 7 00000004:00200000:0.0:1787602613.711809:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787602613.711973:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d743acf-bd40-44c9-89fb-11535243145c+6:13745:x1874436821197952:12345-192.168.206.25@tcp:33:mount.lustre.0 Request processed in 17673us (18844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602613.711985:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:0.0:1787602613.882255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602613.882384:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821198080 00000100:00100000:3.0:1787602613.882394:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821198080 00000100:00100000:3.0:1787602613.882455:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:3.0:1787602613.882466:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+6:13789:x1874436821198080:12345-192.168.206.25@tcp:101:mkdir.0 00010000:00010000:3.0:1787602613.882487:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602613.882510:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47c4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350170 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.882573:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47c52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.882585:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.882601:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602613.882794:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787602613.882798:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602613.882902:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47c52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.882928:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47c4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350170 expref: 8 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.882948:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47c52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350170 expref: 7 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602613.882955:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88a00) 00010000:00010000:3.0:1787602613.882958:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602613.882961:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71a00, rc 0) 00000100:00100000:3.0:1787602613.883539:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+7:13789:x1874436821198080:12345-192.168.206.25@tcp:101:mkdir.0 Request processed in 1072us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602613.883547:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 8 00010000:00010000:3.0:1787602613.981195:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787602614.334212:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4d743acf-bd40-44c9-89fb-11535243145c 00010000:00010000:1.0:1787602615.006813:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602615.751536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602615.751644:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821198208 00000100:00100000:2.0:1787602615.751654:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821198208 00000100:00100000:2.0:1787602615.751737:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:2.0:1787602615.751749:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+7:13841:x1874436821198208:12345-192.168.206.25@tcp:41:lfs.0 00000004:00000024:2.0:1787602615.751789:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787602615.751964:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+7:13841:x1874436821198208:12345-192.168.206.25@tcp:41:lfs.0 Request processed in 216us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602615.751971:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00080000:0.0:1787602615.752301:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602615.757761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602615.758150:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821198336 00000100:00100000:0.0:1787602615.758160:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821198336 00000100:00100000:0.0:1787602615.758242:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:0.0:1787602615.758272:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4d743acf-bd40-44c9-89fb-11535243145c+5:13841:x1874436821198336:12345-192.168.206.25@tcp:13:lfs.0 00002000:00000024:0.0:1787602615.758309:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602615.758398:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4d743acf-bd40-44c9-89fb-11535243145c+5:13841:x1874436821198336:12345-192.168.206.25@tcp:13:lfs.0 Request processed in 130us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602615.758406:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00080000:3.0:1787602615.759271:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602615.761291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602615.761422:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821198464 00000100:00100000:0.0:1787602615.761431:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821198464 00000100:00100000:0.0:1787602615.761530:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:0.0:1787602615.761541:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4d743acf-bd40-44c9-89fb-11535243145c+6:13841:x1874436821198464:12345-192.168.206.25@tcp:13:lfs.0 00002000:00000024:0.0:1787602615.761573:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602615.761664:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4d743acf-bd40-44c9-89fb-11535243145c+6:13841:x1874436821198464:12345-192.168.206.25@tcp:13:lfs.0 Request processed in 124us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602615.761671:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00080000:3.0:1787602615.762227:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602615.960416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602615.960752:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821198592 00000100:00100000:1.0:1787602615.960774:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821198592 00000100:00100000:1.0:1787602615.960851:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 90 00000100:00100000:1.0:1787602615.960861:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+10:13873:x1874436821198592:12345-192.168.206.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787602615.960877:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602615.960893:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011c800/0x576b7af90af47c59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350177 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602615.960919:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011c800/0x576b7af90af47c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350177 expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602615.960929:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011c800/0x576b7af90af47c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350177 expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602615.960938:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c800, rc 0) 00000100:00100000:1.0:1787602615.960993:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13873:x1874436821198592:12345-192.168.206.25@tcp:101:mount.lustre.0 Request processed in 133us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602615.961001:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 90 00000100:00100000:2.0:1787602615.965430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602615.965589:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821198720 00000100:00100000:0.0:1787602615.965599:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821198720 00000100:00100000:0.0:1787602615.965654:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 91 00000100:00100000:0.0:1787602615.965664:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13873:x1874436821198720:12345-192.168.206.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787602615.966005:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13873:x1874436821198720:12345-192.168.206.25@tcp:501:mount.lustre.0 Request processed in 342us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602615.966014:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 91 00000100:00100000:3.0:1787602615.982215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602615.982322:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821198848 00000100:00100000:0.0:1787602615.982331:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821198848 00000100:00100000:0.0:1787602615.982391:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 92 00000100:00100000:0.0:1787602615.982401:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13873:x1874436821198848:12345-192.168.206.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787602615.982953:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13873:x1874436821198848:12345-192.168.206.25@tcp:503:mount.lustre.0 Request processed in 550us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602615.982969:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 92 00000100:00100000:2.0:1787602615.995219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602615.995454:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821198976 00000100:00100000:1.0:1787602615.995463:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821198976 00000100:00100000:1.0:1787602615.995519:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 93 00000100:00100000:1.0:1787602615.995530:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13880:x1874436821198976:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787602615.995874:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13880:x1874436821198976:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 345us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602615.995883:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 93 00000100:00100000:2.0:1787602616.019857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602616.021779:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821199104 00000100:00100000:0.0:1787602616.021791:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821199104 00000100:00100000:0.0:1787602616.021865:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 94 00000100:00100000:0.0:1787602616.021876:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13880:x1874436821199104:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602616.022311:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13880:x1874436821199104:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 436us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602616.022319:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 94 00010000:00010000:0.0:1787602616.030002:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602616.031146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602616.034203:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821199232 00000100:00100000:1.0:1787602616.034218:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821199232 00000100:00100000:1.0:1787602616.034360:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 95 00000100:00100000:1.0:1787602616.034372:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13873:x1874436821199232:12345-192.168.206.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787602616.034401:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602616.034508:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a5011d800/0x576b7af90af47c60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab123501a1 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602616.034548:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a5011d800/0x576b7af90af47c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a1 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602616.034561:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a5011d800/0x576b7af90af47c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a1 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602616.034570:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d800, rc 0) 00000100:00100000:1.0:1787602616.034644:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+12:13873:x1874436821199232:12345-192.168.206.25@tcp:101:mount.lustre.0 Request processed in 274us (3505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602616.034651:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 95 00000100:00100000:2.0:1787602616.040083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602616.040267:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821199360 00000100:00100000:0.0:1787602616.040278:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821199360 00000100:00100000:0.0:1787602616.040334:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 96 00000100:00100000:0.0:1787602616.040345:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+12:13873:x1874436821199360:12345-192.168.206.25@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787602616.040380:0:14371:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787602616.040401:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787602616.040494:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787602616.040497:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787602616.040500:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787602616.042453:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+12:13873:x1874436821199360:12345-192.168.206.25@tcp:256:mount.lustre.0 Request processed in 2100us (2369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602616.042467:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 96 00000100:00100000:1.0:1787602616.047327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602616.047731:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821199488 00000100:00100000:2.0:1787602616.047740:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821199488 00000100:00100000:2.0:1787602616.047857:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 97 00000100:00100000:2.0:1787602616.047868:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+12:13873:x1874436821199488:12345-192.168.206.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787602616.047885:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602616.047901:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94494610a600/0x576b7af90af47c67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab123501a8 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602616.047927:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94494610a600/0x576b7af90af47c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a8 expref: 13 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602616.048027:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94494610a600/0x576b7af90af47c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a8 expref: 13 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602616.048062:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94494610a600, rc 0) 00000100:00100000:2.0:1787602616.048121:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e56a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13873:x1874436821199488:12345-192.168.206.25@tcp:101:mount.lustre.0 Request processed in 254us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.048128:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 97 00000100:00100000:2.0:1787602616.050907:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602616.051063:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821199616 00000100:00100000:0.0:1787602616.051072:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821199616 00000100:00100000:0.0:1787602616.051123:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 98 00000100:00100000:0.0:1787602616.051133:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13873:x1874436821199616:12345-192.168.206.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787602616.051556:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13873:x1874436821199616:12345-192.168.206.25@tcp:501:mount.lustre.0 Request processed in 421us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602616.051564:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 98 00000100:00100000:1.0:1787602616.056600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602616.056688:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821199744 00000100:00100000:2.0:1787602616.056707:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821199744 00000100:00100000:2.0:1787602616.056757:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 99 00000100:00100000:2.0:1787602616.056766:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13873:x1874436821199744:12345-192.168.206.25@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787602616.057320:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13873:x1874436821199744:12345-192.168.206.25@tcp:503:mount.lustre.0 Request processed in 552us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.057328:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 99 00000100:00100000:1.0:1787602616.063411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602616.063542:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821199872 00000100:00100000:0.0:1787602616.063557:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821199872 00000100:00100000:0.0:1787602616.063608:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 100 00000100:00100000:0.0:1787602616.063618:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13884:x1874436821199872:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602616.065218:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13884:x1874436821199872:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 1595us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602616.065241:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 100 00000100:00100000:0.0:1787602616.067819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602616.067915:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821200000 00000100:00100000:2.0:1787602616.067924:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821200000 00000100:00100000:2.0:1787602616.067981:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 101 00000100:00100000:2.0:1787602616.067991:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13884:x1874436821200000:12345-192.168.206.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787602616.068247:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13884:x1874436821200000:12345-192.168.206.25@tcp:502:llog_process_th.0 Request processed in 257us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.068255:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 101 00000100:00100000:1.0:1787602616.076302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602616.076387:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821200128 00000100:00100000:3.0:1787602616.076407:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821200128 00000100:00100000:3.0:1787602616.076462:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:3.0:1787602616.076470:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1874436821200128:12345-192.168.206.25@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787602616.076503:0:14378:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d2f1bc58-39a1-4c5f-8ed9-3111442be699@192.168.206.25@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:3.0:1787602616.076545:0:14378:0:(genops.c:1385:class_connect()) connect: client d2f1bc58-39a1-4c5f-8ed9-3111442be699, cookie 0x576b7af90af47c6e 00000004:00100000:3.0:1787602616.076578:0:14378:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787602616.076875:0:14378:0:(import.c:65:import_set_state_nolock()) ffff944a4a0b8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602616.077944:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:2360:x1874436821200128:12345-192.168.206.25@tcp:38:mount.lustre.0 Request processed in 1449us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.078305:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:1.0:1787602616.088291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602616.088330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602616.088438:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821200256 00000100:00100000:2.0:1787602616.088447:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821200256 00000100:00100000:2.0:1787602616.088523:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821200384 00000100:00100000:2.0:1787602616.088527:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821200384 00000100:00100000:2.0:1787602616.088546:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:2.0:1787602616.088555:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+7:0:x1874436821200256:12345-192.168.206.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787602616.088596:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787602616.088678:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+7:0:x1874436821200256:12345-192.168.206.25@tcp:41:mount.lustre.0 Request processed in 124us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.088685:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:2.0:1787602616.088714:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00100000:2.0:1787602616.088721:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:13873:x1874436821200384:12345-192.168.206.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787602616.088732:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787602616.088756:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:13873:x1874436821200384:12345-192.168.206.25@tcp:41:mount.lustre.0 Request processed in 35us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.088762:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00080000:0.0:1787602616.089017:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602616.093626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602616.094109:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821200512 00000100:00100000:2.0:1787602616.094119:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821200512 00000100:00100000:2.0:1787602616.094348:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:2.0:1787602616.094370:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449481c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:13873:x1874436821200512:12345-192.168.206.25@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787602616.094468:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449481c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:13873:x1874436821200512:12345-192.168.206.25@tcp:40:mount.lustre.0 Request processed in 101us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.094475:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:1.0:1787602616.097601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602616.097760:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821200896 00000100:00100000:2.0:1787602616.097770:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821200896 00000100:00100000:2.0:1787602616.097822:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:2.0:1787602616.097832:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:13873:x1874436821200896:12345-192.168.206.25@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787602616.098278:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787602616.098586:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:13873:x1874436821200896:12345-192.168.206.25@tcp:33:mount.lustre.0 Request processed in 754us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.098596:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:1.0:1787602616.099630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602616.100077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602616.101158:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821200640 00000100:00100000:2.0:1787602616.101170:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821200640 00000100:00100000:2.0:1787602616.101207:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821200768 00000100:00100000:2.0:1787602616.101210:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821200768 00000100:00100000:2.0:1787602616.101226:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:2.0:1787602616.101233:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1874436821200640:12345-192.168.206.25@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787602616.101261:0:15063:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d2f1bc58-39a1-4c5f-8ed9-3111442be699@192.168.206.25@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:2.0:1787602616.101292:0:15063:0:(genops.c:1385:class_connect()) connect: client d2f1bc58-39a1-4c5f-8ed9-3111442be699, cookie 0x576b7af90af47c75 00002000:00100000:2.0:1787602616.101304:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d2f1bc58-39a1-4c5f-8ed9-3111442be699/ffff944947df8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787602616.101314:0:15063:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787602616.101535:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787602616.101563:0:15063:0:(import.c:65:import_set_state_nolock()) ffff944947dfe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602616.101617:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:2360:x1874436821200640:12345-192.168.206.25@tcp:8:mount.lustre.0 Request processed in 383us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.101624:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:0.0:1787602616.101798:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:0.0:1787602616.101804:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1874436821200768:12345-192.168.206.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787602616.101823:0:15842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d2f1bc58-39a1-4c5f-8ed9-3111442be699@192.168.206.25@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1787602616.101851:0:15842:0:(genops.c:1385:class_connect()) connect: client d2f1bc58-39a1-4c5f-8ed9-3111442be699, cookie 0x576b7af90af47c7c 00002000:00100000:0.0:1787602616.101857:0:15842:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d2f1bc58-39a1-4c5f-8ed9-3111442be699/ffff944a68e87800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787602616.101864:0:15842:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787602616.101928:0:15842:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787602616.101944:0:15842:0:(import.c:65:import_set_state_nolock()) ffff944a68e84000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787602616.101984:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:2360:x1874436821200768:12345-192.168.206.25@tcp:8:mount.lustre.0 Request processed in 179us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602616.101991:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:0.0:1787602616.271323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602616.272795:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821201024 00000100:00100000:3.0:1787602616.272810:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821201024 00000100:00100000:3.0:1787602616.272886:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00100000:3.0:1787602616.272897:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:13906:x1874436821201024:12345-192.168.206.25@tcp:101:mkdir.0 00010000:00010000:3.0:1787602616.272940:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602616.272959:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123501d2 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602616.273023:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602616.273052:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602616.273063:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602616.273255:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787602616.273259:0:14380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602616.273340:0:14380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602616.274620:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71000/0x576b7af90af47c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d2 expref: 8 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602616.274639:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d2 expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602616.274648:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88a00) 00010000:00010000:3.0:1787602616.274650:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602616.274654:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71600, rc 0) 00000100:00100000:3.0:1787602616.274765:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+7:13906:x1874436821201024:12345-192.168.206.25@tcp:101:mkdir.0 Request processed in 1868us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602616.274773:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 14 00000001:00100000:2.0:1787602616.420164:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d2f1bc58-39a1-4c5f-8ed9-3111442be699 00000001:00100000:2.0:1787602616.420179:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4d743acf-bd40-44c9-89fb-11535243145c 00000100:00100000:2.0:1787602616.861385:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436839012480:0@lo:400:kworker.0 00000100:00100000:2.0:1787602616.861469:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602616.861515:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436839012352:0@lo:400:kworker.0 00000100:00100000:3.0:1787602616.862867:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436839012096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602616.862920:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602616.862976:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436839012608:0@lo:400:kworker.0 00000100:00100000:3.0:1787602616.863001:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602616.863027:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787602616.863034:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3311:1874436839012224:0@lo:400:kworker.0 00000100:00100000:3.0:1787602616.863079:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602616.864121:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436839012992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602616.864159:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602616.864191:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839012096 00000100:00100000:2.0:1787602616.864198:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839012096 00000100:00100000:2.0:1787602616.864240:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839012992 00000100:00100000:2.0:1787602616.864243:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839012992 00000100:00100000:2.0:1787602616.864260:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787602616.864269:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436839012096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602616.864291:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602616.864329:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436839012096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.864336:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787602616.864352:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787602616.864358:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436839012992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602616.864368:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602616.864399:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436839012992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602616.864405:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787602616.864422:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787602616.864425:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602616.864436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602616.867264:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839012224 00000100:00100000:0.0:1787602616.867280:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839012224 00000100:00100000:3.0:1787602616.867311:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436839012736:0@lo:400:kworker.0 00000100:00100000:1.0:1787602616.867338:0:15842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839012480 00000100:00100000:0.0:1787602616.867338:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787602616.867344:0:15842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839012480 00000100:00100000:0.0:1787602616.867351:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:3311:x1874436839012224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602616.867371:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602616.867383:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602616.867392:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436839012480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602616.868108:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436839012096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602616.868152:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839012608 00000100:00100000:3.0:1787602616.868157:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839012608 00000100:00100000:3.0:1787602616.868186:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839012736 00000100:00100000:3.0:1787602616.868189:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839012736 00000100:00100000:3.0:1787602616.868214:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787602616.868319:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874436839012480:12345-0@lo:400:kworker.0 Request processed in 927us (6848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602616.868319:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:3311:x1874436839012224:12345-0@lo:400:kworker.0 Request processed in 970us (5236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602616.868328:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602616.868328:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787602616.868343:0:15842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839012352 00000100:00100000:1.0:1787602616.868346:0:15842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839012352 00000100:00100000:1.0:1787602616.868366:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602616.868373:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436839012352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602616.868386:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436839012608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602616.868414:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436839012352:12345-0@lo:400:kworker.0 Request processed in 41us (3976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602616.868422:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602616.868437:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874436839012608:12345-0@lo:400:kworker.0 Request processed in 56us (5432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602616.868444:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602616.868463:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787602616.868470:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436839012736:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787602616.868480:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602616.868501:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874436839012736:12345-0@lo:400:kworker.0 Request processed in 31us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602616.868508:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787602616.868541:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3311:1874436839012224:0@lo:400:kworker.0 00000100:00100000:1.0:1787602616.868548:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436839012992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602616.868561:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874436839012480:0@lo:400:kworker.0 00000100:00100000:3.0:1787602616.868626:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874436839012736:0@lo:400:kworker.0 00000100:00100000:3.0:1787602616.868642:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874436839012608:0@lo:400:kworker.0 00000100:00100000:2.0:1787602616.869238:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436839012352:0@lo:400:kworker.0 00000100:00100000:2.0:1787602616.869249:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436839012864:0@lo:400:kworker.0 00000100:00100000:2.0:1787602616.869281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602616.869625:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839012864 00000100:00100000:1.0:1787602616.869630:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839012864 00000100:00100000:1.0:1787602616.869684:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787602616.869691:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436839012864:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787602616.869963:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602616.870156:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874436839012864:12345-0@lo:400:kworker.0 Request processed in 464us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602616.870164:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787602616.870224:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874436839012864:0@lo:400:kworker.0 00010000:00010000:3.0:1787602617.054152:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602618.077427:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787602618.726840:0:16343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787602618.951458:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4d743acf-bd40-44c9-89fb-11535243145c 00000001:00100000:1.0:1787602618.951475:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d2f1bc58-39a1-4c5f-8ed9-3111442be699 00010000:00010000:0.0:1787602619.102630:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787602619.481623:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d2f1bc58-39a1-4c5f-8ed9-3111442be699 00010000:00010000:3.0:1787602620.126163:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602621.150774:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602621.187693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602621.187732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602621.187836:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821201152 00000100:00100000:3.0:1787602621.187846:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821201152 00000100:00100000:3.0:1787602621.187903:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 103 00000100:00100000:3.0:1787602621.187913:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:2364:x1874436821201152:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602621.187976:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:2364:x1874436821201152:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 65us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602621.187983:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 103 00000100:00100000:1.0:1787602621.188411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602621.188461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602621.188549:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821201664 00000100:00100000:3.0:1787602621.188553:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821201664 00000100:00100000:3.0:1787602621.188599:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00100000:3.0:1787602621.188607:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:2364:x1874436821201664:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602621.188648:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:2364:x1874436821201664:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 42us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602621.188655:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00080000:2.0:1787602621.188767:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602621.190095:0:15842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821201408 00000100:00100000:0.0:1787602621.190106:0:15842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821201408 00000100:00100000:1.0:1787602621.190239:0:15842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821201920 00000100:00100000:1.0:1787602621.190244:0:15842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821201920 00000100:00100000:1.0:1787602621.190274:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:1.0:1787602621.190285:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d743acf-bd40-44c9-89fb-11535243145c+5:2364:x1874436821201408:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602621.190345:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d743acf-bd40-44c9-89fb-11535243145c+5:2364:x1874436821201408:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 63us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602621.190354:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00080000:3.0:1787602621.190467:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602621.190472:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602621.190510:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:1.0:1787602621.190518:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2f1bc58-39a1-4c5f-8ed9-3111442be699+5:2364:x1874436821201920:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602621.190547:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2f1bc58-39a1-4c5f-8ed9-3111442be699+5:2364:x1874436821201920:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 30us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602621.190553:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:1.0:1787602621.197707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602621.197889:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821201280 00000100:00100000:3.0:1787602621.197898:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821201280 00000100:00100000:3.0:1787602621.197973:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00100000:3.0:1787602621.197984:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+6:2364:x1874436821201280:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602621.198077:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+6:2364:x1874436821201280:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 95us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602621.198098:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00080000:2.0:1787602621.198222:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602621.201908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602621.202001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602621.204166:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821201536 00000100:00100000:3.0:1787602621.204181:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821201536 00000100:00100000:3.0:1787602621.204319:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821201792 00000100:00100000:3.0:1787602621.204323:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821201792 00000100:00100000:2.0:1787602621.204396:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:2.0:1787602621.204408:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d743acf-bd40-44c9-89fb-11535243145c+5:2364:x1874436821201536:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602621.204486:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d743acf-bd40-44c9-89fb-11535243145c+5:2364:x1874436821201536:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 81us (2586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602621.204493:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00080000:0.0:1787602621.207889:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602621.207899:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602621.209055:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:3.0:1787602621.209069:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+5:2364:x1874436821201792:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602621.209140:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+5:2364:x1874436821201792:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 75us (7139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602621.209148:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:2.0:1787602621.982957:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436839013120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602621.983019:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602621.983095:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839013120 00000100:00100000:2.0:1787602621.983101:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839013120 00000100:00100000:2.0:1787602621.983145:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787602621.983153:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436839013120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602621.983185:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602621.983229:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436839013120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602621.983235:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787602621.983253:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602621.983294:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436839013120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602621.983824:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436839013376:0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.983858:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602621.983885:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436839013888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602621.983906:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602621.983923:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602621.983928:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436839013504:0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.983950:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602621.983984:0:15842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839013376 00000100:00100000:1.0:1787602621.983988:0:15842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839013376 00000100:00100000:1.0:1787602621.984032:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602621.984053:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436839013376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984093:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436839013376:12345-0@lo:400:kworker.0 Request processed in 40us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602621.984099:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602621.984117:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839013504 00000100:00100000:1.0:1787602621.984121:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839013504 00000100:00100000:1.0:1787602621.984225:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787602621.984233:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436839013504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984262:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436839013504:12345-0@lo:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602621.984267:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787602621.984297:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436839013504:0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984306:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436839013376:0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984329:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839013248:0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984423:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602621.984445:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436839013760:0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984465:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602621.984485:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602621.984491:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436839013632:0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984510:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602621.984533:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839013248 00000100:00100000:1.0:1787602621.984536:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839013248 00000100:00100000:1.0:1787602621.984560:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787602621.984567:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:3312:x1874436839013248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984608:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:3312:x1874436839013248:12345-0@lo:400:kworker.0 Request processed in 41us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602621.984615:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787602621.984640:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839013760 00000100:00100000:1.0:1787602621.984643:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839013760 00000100:00100000:1.0:1787602621.984779:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839013632 00000100:00100000:1.0:1787602621.984783:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839013632 00000100:00100000:1.0:1787602621.984813:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787602621.984820:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436839013760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984850:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874436839013760:12345-0@lo:400:kworker.0 Request processed in 31us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602621.984855:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787602621.984868:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787602621.984873:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436839013632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984897:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874436839013632:12345-0@lo:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602621.984902:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787602621.984933:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874436839013632:0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984941:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839013248:0@lo:400:kworker.0 00000100:00100000:1.0:1787602621.984950:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874436839013760:0@lo:400:kworker.0 00000100:00080000:1.0:1787602621.984971:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602621.984975:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602621.984989:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839013888 00000100:00100000:1.0:1787602621.984992:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839013888 00000100:00100000:1.0:1787602621.985015:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602621.985021:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436839013888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602621.985110:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602621.986008:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436839013888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 982us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602621.986017:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602621.986080:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436839013888:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1787602622.080413:0:16492:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdeb282e40 20000000:00000080:1.0:1787602622.080429:0:16492:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94494698b800 uarg=0000000000000000 20000000:01000000:1.0:1787602622.080464:0:16492:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787602622.080469:0:16492:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787602622.080474:0:16492:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787602622.081156:0:16493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787602622.081398:0:16492:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787602622.088865:0:16492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787602622.088988:0:16492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089008:0:16492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a40031000/0x576b7af90af47988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47981 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089016:0:16492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a5011de00/0x576b7af90af479d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af479ce expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089023:0:16492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a5011c200/0x576b7af90af47a45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47a3e expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089032:0:16492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff944a7c458000/0x576b7af90af47c2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350146 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089361:0:16492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94494610a600/0x576b7af90af47c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a8 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089369:0:16492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089410:0:16492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94494610a600/0x576b7af90af47c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a8 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089424:0:16492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94494610a600/0x576b7af90af47c67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a8 expref: 12 pid: 14373 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602622.089437:0:16492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874436839014016:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602622.089578:0:16492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a7c458000/0x576b7af90af47c2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350146 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089587:0:16492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a7c458000/0x576b7af90af47c2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350146 expref: 12 pid: 14372 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602622.089595:0:16492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874436839014144:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602622.089628:0:16492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a5011c200/0x576b7af90af47a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af47a3e expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089635:0:16492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a5011c200/0x576b7af90af47a45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af47a3e expref: 18 pid: 14371 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602622.089643:0:16492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874436839014272:0@lo:104: 00000100:00100000:0.0:1787602622.089752:0:16492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602622.089887:0:16492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a5011de00/0x576b7af90af479d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af479ce expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.089896:0:16492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a5011de00/0x576b7af90af479d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af479ce expref: 18 pid: 14373 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602622.089905:0:16492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b73b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874436839014400:0@lo:104: 00000100:00100000:0.0:1787602622.089927:0:16492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602622.092187:0:16492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff944a40031000/0x576b7af90af47988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x576b7af90af47981 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.092853:0:16492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff944a40031000/0x576b7af90af47988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x576b7af90af47981 expref: 18 pid: 14371 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602622.092868:0:16492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b72300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874436839014528:0@lo:104: 00000100:00100000:0.0:1787602622.092922:0:16492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602622.093882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602622.093913:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821202048 00000100:00100000:3.0:1787602622.093921:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821202048 00010000:00010000:3.0:1787602622.093958:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94494610a600/0x576b7af90af47c67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a8 expref: 13 pid: 14373 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602622.093990:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:3.0:1787602622.093999:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:2362:x1874436821202048:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602622.094011:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602622.094017:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94494610a600/0x576b7af90af47c67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a8 expref: 13 pid: 14373 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.094028:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94494610a600/0x576b7af90af47c67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a8 expref: 13 pid: 14373 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.094070:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602622.094114:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:2362:x1874436821202048:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 117us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602622.094131:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:2.0:1787602622.095021:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839014272 00000100:00100000:2.0:1787602622.095030:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839014272 00000100:00100000:2.0:1787602622.095087:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839014400 00000100:00100000:2.0:1787602622.095090:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839014400 00000100:00100000:2.0:1787602622.095107:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602622.095123:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+4:16492:x1874436839014272:12345-0@lo:104: 00010000:00010000:2.0:1787602622.095137:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602622.095203:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787602622.095209:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+4:16492:x1874436839014272:12345-0@lo:104: Request processed in 88us (5458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602622.095216:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602622.095231:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787602622.095236:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:16492:x1874436839014400:12345-0@lo:104: 00010000:00010000:2.0:1787602622.095244:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602622.095276:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787602622.095280:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:16492:x1874436839014400:12345-0@lo:104: Request processed in 45us (5354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602622.095286:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787602622.095394:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787602622.095400:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095407:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459e00 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:3.0:1787602622.095411:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095418:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602622.095424:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602622.095429:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787602622.095462:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095468:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602622.095488:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095494:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a7c459e00/0x576b7af90af47a3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af47a45 expref: -99 pid: 15777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095508:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602622.095511:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095529:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:3.0:1787602622.095531:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095538:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602622.095544:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602622.095549:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787602622.095563:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095568:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602622.095583:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095589:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a5011d600/0x576b7af90af479ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af479d5 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095598:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602622.095599:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602622.095600:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602622.095607:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602622.095626:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3314:1874436839014656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602622.095672:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602622.095718:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3311:1874436839014784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602622.095755:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602622.095786:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839014656 00000100:00100000:3.0:1787602622.095791:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839014656 00010000:00010000:3.0:1787602622.095826:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a5011c200/0x576b7af90af47a45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47a3e expref: 19 pid: 14371 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602622.095844:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839014784 00000100:00100000:3.0:1787602622.095847:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839014784 00010000:00010000:3.0:1787602622.095858:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a5011de00/0x576b7af90af479d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af479ce expref: 20 pid: 14373 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602622.095871:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602622.095876:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+20:3314:x1874436839014656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602622.095887:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602622.095892:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a5011c200/0x576b7af90af47a45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47a3e expref: 20 pid: 14371 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095902:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a5011c200/0x576b7af90af47a45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af47a3e expref: 20 pid: 14371 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.095916:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602622.095944:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+20:3314:x1874436839014656:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602622.095950:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602622.095964:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602622.095970:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449450c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:3311:x1874436839014784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602622.095977:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602622.095981:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a5011de00/0x576b7af90af479d5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af479ce expref: 19 pid: 14373 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.096001:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a5011de00/0x576b7af90af479d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af479ce expref: 19 pid: 14373 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.096011:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602622.096055:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449450c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:3311:x1874436839014784:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602622.096063:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602622.096133:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3311:1874436839014784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602622.096154:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3314:1874436839014656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602622.097794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602622.097845:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821202176 00000100:00100000:3.0:1787602622.097852:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821202176 00010000:00010000:3.0:1787602622.097881:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a7c458000/0x576b7af90af47c2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350146 expref: 13 pid: 14372 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602622.097911:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:3.0:1787602622.097919:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:2364:x1874436821202176:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602622.097931:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602622.097937:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a7c458000/0x576b7af90af47c2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350146 expref: 13 pid: 14372 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.097948:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a7c458000/0x576b7af90af47c2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350146 expref: 13 pid: 14372 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.097966:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602622.098008:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:2364:x1874436821202176:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 89us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602622.098028:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:0.0:1787602622.099572:0:16492:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a48eb3000 going to sleep for 11 seconds 00010000:00010000:0.0:1787602622.099606:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94494610a600/0x576b7af90af47c67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501a8 expref: 12 pid: 14373 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602622.099621:0:16492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874436839014016:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602622.099631:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a7c458000/0x576b7af90af47c2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350146 expref: 11 pid: 14372 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602622.099639:0:16492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874436839014144:192.168.206.25@tcp:104: 00010000:00010000:0.0:1787602622.099649:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5011c200/0x576b7af90af47a45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af47a3e expref: 18 pid: 14371 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602622.099656:0:16492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874436839014272:0@lo:104: 00000100:00100000:2.0:1787602622.099760:0:14362:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787602622.099775:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839014528 00000100:00100000:2.0:1787602622.099781:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839014528 00000100:00100000:2.0:1787602622.099864:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787602622.099874:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:16492:x1874436839014528:12345-0@lo:104: 00010000:00010000:2.0:1787602622.099889:0:14362:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602622.099960:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787602622.099966:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+3:16492:x1874436839014528:12345-0@lo:104: Request processed in 95us (7043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602622.099982:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787602622.100069:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602622.100076:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100082:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458400 already unused, calling callback (ffffffffc1ce6c20) 10000000:00010000:3.0:1787602622.100086:0:14367:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100094:0:14367:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602622.100100:0:14367:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602622.100107:0:14367:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787602622.100143:0:14367:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100149:0:14367:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602622.100167:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100173:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.125@tcp lock: ffff944a7c458400/0x576b7af90af47981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x576b7af90af47988 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100187:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602622.100188:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602622.100190:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602622.100204:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839014912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602622.100245:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602622.100293:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839014912 00000100:00100000:3.0:1787602622.100298:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839014912 00010000:00010000:3.0:1787602622.100319:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff944a40031000/0x576b7af90af47988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47981 expref: 18 pid: 14371 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602622.100339:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602622.100345:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:3312:x1874436839014912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602622.100373:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602622.100380:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff944a40031000/0x576b7af90af47988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x576b7af90af47981 expref: 18 pid: 14371 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100390:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff944a40031000/0x576b7af90af47988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x576b7af90af47981 expref: 18 pid: 14371 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100407:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100414:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100427:0:14363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100434:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100441:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100447:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100458:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602622.100462:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100468:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100476:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.100485:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602622.100513:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:3312:x1874436839014912:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602622.100520:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602622.100548:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839014912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787602622.100707:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a5011de00/0x576b7af90af479d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af479ce expref: 17 pid: 14373 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602622.100717:0:16492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b73b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874436839014400:0@lo:104: 00010000:00010000:0.0:1787602622.100727:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a40031000/0x576b7af90af47988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x576b7af90af47981 expref: 16 pid: 14371 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602622.100736:0:16492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b72300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16492:1874436839014528:0@lo:104: 00010000:00010000:0.0:1787602622.100765:0:16492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.100774:0:16492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.100781:0:16492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602622.100788:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff944a7c459600/0x576b7af90af47c91 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602622.176798:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602623.199841:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602623.306541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602623.306659:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821202304 00000100:00100000:3.0:1787602623.306668:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821202304 00000100:00100000:3.0:1787602623.306720:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 105 00000100:00100000:3.0:1787602623.306731:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+11:13759:x1874436821202304:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602623.306747:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602623.306766:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d71000/0x576b7af90af47c98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab123501d9 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602623.306808:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71000/0x576b7af90af47c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d9 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602623.306820:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d71000/0x576b7af90af47c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d9 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602623.306838:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71000, rc 0) 00000100:00100000:3.0:1787602623.307724:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+12:13759:x1874436821202304:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 Request processed in 991us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602623.307733:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 105 00000100:00100000:3.0:1787602623.311450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602623.312357:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821202432 00000100:00100000:2.0:1787602623.312368:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821202432 00000100:00100000:2.0:1787602623.312437:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 106 00000100:00100000:2.0:1787602623.312447:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+12:13759:x1874436821202432:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.312703:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+12:13759:x1874436821202432:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 Request processed in 256us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602623.312711:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 106 00000100:00100000:3.0:1787602623.314902:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602623.314978:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821202560 00000100:00100000:0.0:1787602623.314987:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821202560 00000100:00100000:0.0:1787602623.315030:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 107 00000100:00100000:0.0:1787602623.315063:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+12:13759:x1874436821202560:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602623.315245:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+12:13759:x1874436821202560:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 Request processed in 184us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602623.315253:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 107 00000100:00100000:2.0:1787602623.332018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602623.332159:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821202688 00000100:00100000:3.0:1787602623.332168:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821202688 00000100:00100000:3.0:1787602623.332213:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 108 00000100:00100000:3.0:1787602623.332223:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+12:13759:x1874436821202688:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602623.332238:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602623.332254:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d71200/0x576b7af90af47c9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51ae90ab123501e0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602623.332281:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d71200/0x576b7af90af47c9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501e0 expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602623.332291:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d71200/0x576b7af90af47c9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501e0 expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602623.332300:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71200, rc 0) 00000100:00100000:3.0:1787602623.335358:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13759:x1874436821202688:12345-192.168.206.25@tcp:101:ll_cfg_requeue.0 Request processed in 3125us (3338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602623.335371:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 108 00000100:00100000:3.0:1787602623.340712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602623.340742:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821202816 00000100:00100000:3.0:1787602623.340761:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821202816 00000100:00100000:3.0:1787602623.340816:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 109 00000100:00100000:3.0:1787602623.340826:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13759:x1874436821202816:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602623.341091:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13759:x1874436821202816:12345-192.168.206.25@tcp:501:ll_cfg_requeue.0 Request processed in 264us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602623.341099:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 109 00000100:00100000:2.0:1787602623.345681:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602623.345716:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821202944 00000100:00100000:2.0:1787602623.345725:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821202944 00000100:00100000:2.0:1787602623.345769:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 110 00000100:00100000:2.0:1787602623.345779:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13759:x1874436821202944:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.345981:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:13759:x1874436821202944:12345-192.168.206.25@tcp:503:ll_cfg_requeue.0 Request processed in 203us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602623.345990:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 110 10000000:01000000:0.0:1787602623.517832:0:14375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602623.517849:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a7554e000 from 10 10000000:01000000:0.0:1787602623.517854:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602623.517898:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47ca6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602623.517910:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47ca6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602623.517922:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47ca6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602623.517947:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602623.518016:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602623.518417:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489589c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602623.518824:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839015040 00000100:00100000:3.0:1787602623.518833:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839015040 00000100:00100000:3.0:1787602623.518889:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787602623.518899:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+16:14375:x1874436839015040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602623.518913:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602623.518927:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff944a47d70000/0x576b7af90af47cad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47ca6 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602623.518949:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff944a47d70000/0x576b7af90af47cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47ca6 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602623.518959:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff944a47d70000/0x576b7af90af47cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47ca6 expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602623.518968:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d70000, rc 0) 00000100:00100000:3.0:1787602623.519021:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:14375:x1874436839015040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602623.519028:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787602623.519185:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602623.519201:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47ca6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47cad expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602623.519212:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47ca6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47cad expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602623.519288:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602623.519322:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602623.519355:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4d3293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602623.519483:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839015168 00000100:00100000:2.0:1787602623.519488:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839015168 00000100:00100000:2.0:1787602623.519510:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787602623.519518:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a47c60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:14375:x1874436839015168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602623.520434:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602623.520475:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602623.520519:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602623.520541:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a489589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602623.520554:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839015296 00000100:00100000:0.0:1787602623.520558:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839015296 00000100:00100000:0.0:1787602623.520592:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787602623.520598:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:14375:x1874436839015296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.520730:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a47c60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:14375:x1874436839015168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1211us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602623.520738:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787602623.521494:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:14375:x1874436839015296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 893us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602623.521502:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787602623.522199:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787602623.528063:0:16560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787602623.528274:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787602623.528294:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602623.528305:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47ca6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47cad expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602623.528323:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a7c458a00/0x576b7af90af47ca6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47cad expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602623.528333:0:14375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602623.528337:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944a7c906800 from 10 10000000:01000000:0.0:1787602623.528340:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602623.528374:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a7c458c00/0x576b7af90af47cb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602623.528381:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff944a7c458c00/0x576b7af90af47cb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602623.528391:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff944a7c458c00/0x576b7af90af47cb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602623.528413:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944947b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602623.528481:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602623.528522:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46a9aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602623.531821:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839015424 00000100:00100000:2.0:1787602623.531836:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839015424 00000100:00100000:2.0:1787602623.531894:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787602623.531904:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+17:14375:x1874436839015424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602623.531919:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602623.531936:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94494610b600/0x576b7af90af47cbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47cb4 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.531963:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94494610b600/0x576b7af90af47cbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47cb4 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.531973:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94494610b600/0x576b7af90af47cbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47cb4 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.531982:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94494610b600, rc 0) 00000100:00100000:2.0:1787602623.532070:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:14375:x1874436839015424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (3590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602623.532077:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787602623.532129:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944947b72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602623.532145:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff944a7c458c00/0x576b7af90af47cb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47cbb expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.532154:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff944a7c458c00/0x576b7af90af47cb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47cbb expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602623.532214:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.532260:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602623.532280:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc180 going to sleep for 11 seconds 00000100:00100000:2.0:1787602623.532305:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839015552 00000100:00100000:2.0:1787602623.532309:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839015552 00000100:00100000:2.0:1787602623.532330:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787602623.532336:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:14375:x1874436839015552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.532555:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:14375:x1874436839015552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602623.532562:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787602623.532593:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.532619:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.532669:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602623.532683:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc180 going to sleep for 11 seconds 00000100:00100000:2.0:1787602623.532694:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839015680 00000100:00100000:2.0:1787602623.532698:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839015680 00000100:00100000:2.0:1787602623.532719:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787602623.532725:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:14375:x1874436839015680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.532858:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:14375:x1874436839015680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602623.532865:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787602623.532900:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787602623.533527:0:16561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787602623.533576:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787602623.533591:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787602623.533598:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff944a7c458c00/0x576b7af90af47cb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47cbb expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.533609:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff944a7c458c00/0x576b7af90af47cb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47cbb expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602623.533627:0:14375:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787602623.533630:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff944946355000 from 10 10000000:01000000:2.0:1787602623.533633:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787602623.533656:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.125@tcp lock: ffff94494610bc00/0x576b7af90af47cc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.533663:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.125@tcp lock: ffff94494610bc00/0x576b7af90af47cc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.533671:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.125@tcp lock: ffff94494610bc00/0x576b7af90af47cc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602623.533684:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.533716:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602623.533732:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602623.533747:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839015808 00000100:00100000:2.0:1787602623.533751:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839015808 00000100:00100000:2.0:1787602623.533774:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787602623.533781:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+18:14375:x1874436839015808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602623.533792:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602623.533819:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94494610b800/0x576b7af90af47cc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x576b7af90af47cc2 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.533837:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94494610b800/0x576b7af90af47cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x576b7af90af47cc2 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.533846:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94494610b800/0x576b7af90af47cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x576b7af90af47cc2 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.533865:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94494610b800, rc 0) 00000100:00100000:2.0:1787602623.533897:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:14375:x1874436839015808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602623.533903:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787602623.533937:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602623.533950:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.125@tcp lock: ffff94494610bc00/0x576b7af90af47cc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47cc9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.533957:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.125@tcp lock: ffff94494610bc00/0x576b7af90af47cc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x576b7af90af47cc9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602623.533992:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.534015:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602623.534028:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602623.534059:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839015936 00000100:00100000:2.0:1787602623.534062:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839015936 00000100:00100000:2.0:1787602623.534083:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787602623.534090:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:14375:x1874436839015936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.534262:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:14375:x1874436839015936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602623.534270:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787602623.534301:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839015936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.534326:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839016064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.534360:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602623.534381:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a6e4e1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787602623.534391:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839016064 00000100:00100000:2.0:1787602623.534394:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839016064 00000100:00100000:2.0:1787602623.534415:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787602623.534421:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:14375:x1874436839016064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602623.534541:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:14375:x1874436839016064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602623.534548:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787602623.541323:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0c3bd976-3721-4ec4-bd04-79d86542b9eb:14375:1874436839016064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787602623.548483:0:16562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787602623.548665:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787602623.548692:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787602623.548702:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.125@tcp lock: ffff94494610bc00/0x576b7af90af47cc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47cc9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602623.548714:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.125@tcp lock: ffff94494610bc00/0x576b7af90af47cc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x576b7af90af47cc9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602623.586506:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787602624.221194:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602625.146347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.147099:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821203072 00000100:00100000:1.0:1787602625.147112:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821203072 00000100:00100000:1.0:1787602625.147298:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:1.0:1787602625.147310:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+6:14416:x1874436821203072:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602625.147337:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602625.147374:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123501e7 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.147467:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47cd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.147485:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.147502:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.147520:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47cde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.147528:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.147535:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787602625.149853:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602625.150538:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47ce5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.150563:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.150577:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.150952:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787602625.150957:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602625.151106:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151122:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151130:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47cd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151138:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151144:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011de00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.151148:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151156:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47cd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151171:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88a00) 00010000:00010000:1.0:1787602625.151174:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.151179:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151185:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151199:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151215:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47cde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151220:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47cde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151225:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.151227:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47cde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151233:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47cde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151242:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff944a43b20b00) 00010000:00010000:1.0:1787602625.151245:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.151248:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47cde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151254:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47cde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151302:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501e7 expref: 8 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151318:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d000/0x576b7af90af47ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501e7 expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.151326:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff944a43b20300) 00010000:00010000:1.0:1787602625.151328:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602625.151337:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d000, rc 0) 00000100:00100000:1.0:1787602625.151750:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+7:14416:x1874436821203072:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 4438us (5414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602625.151761:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:0.0:1787602625.156970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.159579:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821203328 00000100:00100000:1.0:1787602625.159723:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821203328 00000100:00100000:0.0:1787602625.162801:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:0.0:1787602625.162820:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+7:14416:x1874436821203328:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602625.162847:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602625.162887:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47cec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123501ee expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.162985:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47cf3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.163020:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.163057:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.163351:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47cfa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.163372:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47cfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.163383:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47cfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.163977:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47d01 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.163987:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47d01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.163994:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47d01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602625.164856:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787602625.165259:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165269:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47cf3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165275:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165286:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602625.165290:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165297:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47cf3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165311:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff944a43b20300) 00010000:00010000:0.0:1787602625.165314:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602625.165318:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47cf3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165323:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47cf3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165336:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47cfa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165342:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47cfa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165347:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47cfa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165352:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602625.165355:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47cfa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165361:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47cfa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165385:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff944a48ace500) 00010000:00010000:0.0:1787602625.165387:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602625.165391:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47cfa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.165397:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47cfa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.169773:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47cec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501ee expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.169942:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459600/0x576b7af90af47d01 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501ee expref: 9 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.169952:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48ace700) 00010000:00010000:0.0:1787602625.169954:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602625.169957:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459600, rc 0) 00000100:00100000:0.0:1787602625.170147:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+9:14416:x1874436821203328:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 7328us (13185us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787602625.170157:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:0.0:1787602625.175881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.176274:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821203456 00000100:00100000:1.0:1787602625.176289:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821203456 00000100:00100000:1.0:1787602625.176532:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00100000:1.0:1787602625.176545:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+9:14416:x1874436821203456:12345-192.168.206.25@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787602625.176698:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+9:14416:x1874436821203456:12345-192.168.206.25@tcp:59:lhsmtool_posix.0 Request processed in 155us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602625.176707:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 17 00000100:00100000:3.0:1787602625.218887:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602625.219190:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821203584 00000100:00100000:0.0:1787602625.219204:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821203584 00000100:00100000:0.0:1787602625.219280:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00100000:0.0:1787602625.219293:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+9:14422:x1874436821203584:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:0.0:1787602625.219322:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602625.219347:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47d0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123501f5 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.219452:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.219470:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.219484:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.219501:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47d1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.219509:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47d1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.219516:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47d1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220500:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220514:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220522:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220529:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602625.220534:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220552:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220569:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88a00) 00010000:00010000:0.0:1787602625.220572:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602625.220577:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220583:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220597:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47d1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220604:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47d1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220609:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47d1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220615:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602625.220617:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47d1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220623:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47d1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220630:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff944a48ace500) 00010000:00010000:0.0:1787602625.220633:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602625.220636:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47d1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220781:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47d1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220839:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47d0f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501f5 expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220850:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88a00) 00010000:00010000:0.0:1787602625.220852:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602625.220855:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47d0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501f5 expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.220864:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459400, rc 0) 00000100:00100000:0.0:1787602625.221031:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+9:14422:x1874436821203584:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1739us (2155us total) trans 0 rc 301/301 00000100:00100000:0.0:1787602625.221086:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 18 00000100:00100000:0.0:1787602625.226768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.226894:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821203712 00000100:00100000:1.0:1787602625.226907:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821203712 00000100:00100000:1.0:1787602625.226977:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:1.0:1787602625.226990:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4d743acf-bd40-44c9-89fb-11535243145c+9:14422:x1874436821203712:12345-192.168.206.25@tcp:700:lfs.0 00000100:00100000:1.0:1787602625.227141:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4d743acf-bd40-44c9-89fb-11535243145c+9:14422:x1874436821203712:12345-192.168.206.25@tcp:700:lfs.0 Request processed in 153us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602625.227149:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:2.0:1787602625.231186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.231297:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821203968 00000100:00100000:1.0:1787602625.231310:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821203968 00000100:00100000:1.0:1787602625.231393:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 19 00000100:00100000:1.0:1787602625.231405:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+9:14422:x1874436821203968:12345-192.168.206.25@tcp:36:lfs.0 00010000:00010000:1.0:1787602625.231482:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602625.231515:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47c52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350170 expref: 9 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.231559:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88a00) 00010000:00010000:1.0:1787602625.231565:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602625.232365:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.232386:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d2 expref: 5 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.232397:0:14379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.232440:0:14379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d2 expref: 5 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.232456:0:14379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d2 expref: 5 pid: 14380 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602625.232474:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14379:1874436839016192:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602625.232586:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a47962e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602625.239683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602625.239801:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821204096 00000100:00100000:3.0:1787602625.239814:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821204096 00010000:00010000:3.0:1787602625.239891:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d2 expref: 6 pid: 14380 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602625.239949:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:3.0:1787602625.239961:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:2362:x1874436821204096:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602625.239979:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602625.239988:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d2 expref: 6 pid: 14380 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.240003:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d2 expref: 6 pid: 14380 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.240029:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88a00) 00010000:00010000:3.0:1787602625.240054:0:14365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.240066:0:14365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.240074:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.240096:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602625.240173:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:2362:x1874436821204096:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 214us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602625.240181:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00080000:2.0:1787602625.240254:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602625.240927:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47c8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501d2 expref: 5 pid: 14380 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602625.240950:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14379:1874436839016192:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602625.240976:0:14379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.240987:0:14379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.241013:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.241360:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.241374:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.241383:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.243006:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787602625.243025:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.243853:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.243868:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.243875:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011c200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.243881:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.243889:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.243909:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a58b88a00) 00010000:00010000:1.0:1787602625.243912:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.243933:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.243940:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d24 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602625.243970:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015b9ff86 reply state 0000000046d24997 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602625.243981:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602625.244473:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+10:14422:x1874436821203968:12345-192.168.206.25@tcp:36:lfs.0 Request processed in 13064us (13295us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787602625.244484:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 19 00010000:00010000:3.0:1787602625.248217:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602625.256897:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.256935:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.256944:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.256951:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.256956:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.256964:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.256986:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff944a43b20b00) 00010000:00010000:1.0:1787602625.256990:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.256995:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.257020:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d2b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602625.361239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602625.361386:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821204224 00000100:00100000:0.0:1787602625.361525:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821204224 00000100:00100000:0.0:1787602625.361613:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 20 00000100:00100000:0.0:1787602625.361627:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+9:14430:x1874436821204224:12345-192.168.206.25@tcp:101:lctl.0 00010000:00010000:0.0:1787602625.361664:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602625.361802:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab123501fc expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.362033:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47d39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.362184:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47d39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.362198:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47d39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.362368:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787602625.362374:0:14380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602625.362562:0:14380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47d39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.362598:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458000/0x576b7af90af47d32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501fc expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.362622:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459e00/0x576b7af90af47d39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab123501fc expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.362632:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48ace500) 00010000:00010000:1.0:1787602625.362635:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602625.362640:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459e00, rc 0) 00000100:00100000:1.0:1787602625.362918:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+10:14430:x1874436821204224:12345-192.168.206.25@tcp:101:lctl.0 Request processed in 1293us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602625.362928:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 20 00000100:00100000:2.0:1787602625.386233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.386314:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821204352 00000100:00100000:1.0:1787602625.386327:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821204352 00000100:00100000:1.0:1787602625.386404:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00100000:1.0:1787602625.386417:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+5:14431:x1874436821204352:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602625.386443:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602625.386469:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350203 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.386578:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.386594:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.386607:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.386693:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787602625.386697:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602625.386726:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.386753:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350203 expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.386772:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011c200/0x576b7af90af47d47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350203 expref: 6 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.386781:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48ace500) 00010000:00010000:1.0:1787602625.386794:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602625.386798:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011c200, rc 0) 00000100:00100000:1.0:1787602625.386877:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:14431:x1874436821204352:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 462us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602625.386884:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 21 00000100:00100000:0.0:1787602625.392251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.394231:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821204480 00000100:00100000:1.0:1787602625.394251:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821204480 00000100:00100000:1.0:1787602625.394368:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 22 00000100:00100000:1.0:1787602625.394379:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+6:14431:x1874436821204480:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602625.394403:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602625.394427:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235020a expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.394506:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47d55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.394522:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47d55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.394535:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47d55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.394555:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.394563:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.394571:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.394973:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47d63 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.394994:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47d63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395006:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47d63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.395130:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787602625.395134:0:14380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602625.395169:0:14380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47d63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395183:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47d55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395189:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47d55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395200:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47d55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395205:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011dc00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.395209:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47d55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395215:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47d55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395236:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48ace500) 00010000:00010000:1.0:1787602625.395238:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.395242:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47d55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395247:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47d55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395259:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395274:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395280:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395284:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.395287:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395293:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395301:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff944a43b20b00) 00010000:00010000:1.0:1787602625.395303:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.395306:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395311:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395350:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235020a expref: 8 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395364:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47d63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235020a expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.395371:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff944a43b20000) 00010000:00010000:1.0:1787602625.395373:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602625.395381:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011ca00, rc 0) 00000100:00100000:1.0:1787602625.395467:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+7:14431:x1874436821204480:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1088us (3230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602625.395476:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 22 00000100:00100000:2.0:1787602625.399382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.399713:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821204736 00000100:00100000:1.0:1787602625.399725:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821204736 00000100:00100000:1.0:1787602625.399805:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 23 00000100:00100000:1.0:1787602625.399815:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+7:14431:x1874436821204736:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602625.399835:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602625.399853:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350211 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.399971:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787602625.400362:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350211 expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.400377:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48ace500) 00010000:00010000:1.0:1787602625.400380:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602625.400385:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350211 expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.400399:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011d600, rc 0) 00000100:00100000:1.0:1787602625.401412:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+8:14431:x1874436821204736:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1592us (2032us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787602625.401426:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 23 00000100:00100000:2.0:1787602625.411970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.412082:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821204992 00000100:00100000:1.0:1787602625.412092:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821204992 00000100:00100000:1.0:1787602625.412145:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 24 00000100:00100000:1.0:1787602625.412167:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+8:14431:x1874436821204992:12345-192.168.206.25@tcp:36:lfs.0 00010000:00010000:1.0:1787602625.412228:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602625.412253:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47d63 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235020a expref: 8 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.412271:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff944a43b20000) 00010000:00010000:1.0:1787602625.412280:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602625.412301:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.412313:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.412322:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602625.412526:0:14380:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000346df1ab reply state 00000000330cad64 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602625.412536:0:14380:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787602625.412549:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787602625.412630:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+9:14431:x1874436821204992:12345-192.168.206.25@tcp:36:lfs.0 Request processed in 464us (668us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787602625.412638:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 24 00010000:00010000:3.0:1787602625.415017:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.415072:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.415082:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.415090:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602625.415095:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.415103:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.415123:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff944a43b20b00) 00010000:00010000:3.0:1787602625.415126:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787602625.415131:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.415138:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47d78 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602625.421625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602625.423566:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821205248 00000100:00100000:3.0:1787602625.423587:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821205248 00000100:00100000:3.0:1787602625.423671:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:3.0:1787602625.423685:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+8:14431:x1874436821205248:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:3.0:1787602625.424624:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+9:14431:x1874436821205248:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 936us (3009us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787602625.424635:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:0.0:1787602625.432282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.432397:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821205504 00000100:00100000:1.0:1787602625.432410:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821205504 00000100:00100000:1.0:1787602625.432530:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 25 00000100:00100000:1.0:1787602625.432542:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+9:14431:x1874436821205504:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602625.432571:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602625.432613:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350218 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.432707:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.432724:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.432737:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.432754:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.432761:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.432768:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.432951:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787602625.433133:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433141:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433148:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433154:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011de00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.433159:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433187:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433202:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48ace500) 00010000:00010000:1.0:1787602625.433205:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.433211:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433217:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47d86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433232:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433238:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433244:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433251:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.433253:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433260:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433267:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff944a43b20000) 00010000:00010000:1.0:1787602625.433270:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.433273:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433288:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47d8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433333:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47d7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350218 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433344:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48ace500) 00010000:00010000:1.0:1787602625.433346:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602625.433350:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350218 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.433360:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011ca00, rc 0) 00000100:00100000:1.0:1787602625.433443:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+10:14431:x1874436821205504:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 903us (1173us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787602625.433450:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 25 00000100:00100000:2.0:1787602625.435593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602625.435681:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821205632 00000100:00100000:3.0:1787602625.435694:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821205632 00000100:00100000:3.0:1787602625.435762:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 26 00000100:00100000:3.0:1787602625.435773:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+10:14431:x1874436821205632:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:3.0:1787602625.435811:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602625.435838:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47d9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235021f expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.436799:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.436820:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.436834:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602625.436965:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787602625.436970:0:14380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602625.436998:0:14380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.437285:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47d9b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235021f expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.437308:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235021f expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.437317:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff944a58b88400) 00010000:00010000:3.0:1787602625.437320:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602625.437341:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71600, rc 0) 00000100:00100000:3.0:1787602625.437465:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+11:14431:x1874436821205632:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 1692us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602625.437475:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 26 00000100:00100000:2.0:1787602625.443430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602625.444031:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821205760 00000100:00100000:0.0:1787602625.444412:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821205760 00000100:00100000:3.0:1787602625.444573:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:3.0:1787602625.444591:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+11:14431:x1874436821205760:12345-192.168.206.25@tcp:37:lfs.0 00000100:00100000:2.0:1787602625.459488:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+11:14431:x1874436821205760:12345-192.168.206.25@tcp:37:lfs.0 Request processed in 14886us (16056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602625.459505:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:2.0:1787602625.465170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602625.465286:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821206016 00000100:00100000:0.0:1787602625.465298:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821206016 00000100:00100000:0.0:1787602625.465419:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:0.0:1787602625.465433:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2f1bc58-39a1-4c5f-8ed9-3111442be699+11:14431:x1874436821206016:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:0.0:1787602625.465797:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d2f1bc58-39a1-4c5f-8ed9-3111442be699+12:14431:x1874436821206016:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 357us (633us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787602625.465807:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:3.0:1787602625.527335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.527554:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821206144 00000100:00100000:1.0:1787602625.527568:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821206144 00000100:00100000:1.0:1787602625.527644:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 27 00000100:00100000:1.0:1787602625.527665:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+10:14437:x1874436821206144:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602625.527690:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602625.527715:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47da9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350226 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.527810:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47db0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.527926:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47db0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528023:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47db0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528080:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47db7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528088:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528096:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528234:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47dbe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528243:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47dbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528250:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47dbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.528285:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787602625.528289:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602625.528340:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47dbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528573:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47db0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528582:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47db0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528600:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47db0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528608:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.528613:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47db0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528622:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47db0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528638:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48ace500) 00010000:00010000:1.0:1787602625.528708:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.528715:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47db0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528721:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d200/0x576b7af90af47db0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528738:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528746:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47db7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528751:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47db7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528756:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011de00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.528759:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47db7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528777:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47db7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528801:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff944a43b20000) 00010000:00010000:1.0:1787602625.528804:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.528807:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47db7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528813:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011de00/0x576b7af90af47db7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.528925:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ca00/0x576b7af90af47da9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350226 expref: 12 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.531194:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011dc00/0x576b7af90af47dbe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350226 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.531209:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff944a58b88400) 00010000:00010000:1.0:1787602625.531212:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787602625.531216:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a5011dc00, rc 0) 00000100:00100000:1.0:1787602625.531327:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+11:14437:x1874436821206144:12345-192.168.206.25@tcp:101:bash.0 Request processed in 3671us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602625.531338:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 27 00000100:00100000:3.0:1787602625.536280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.536895:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821206400 00000100:00100000:1.0:1787602625.536910:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821206400 00000100:00100000:1.0:1787602625.537361:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 28 00000100:00100000:1.0:1787602625.537381:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+11:14437:x1874436821206400:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602625.537431:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602625.537459:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47dc5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235022d expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.537632:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.537718:0:14380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235021f expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.537730:0:14380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.537776:0:14380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235021f expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.537803:0:14380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235021f expref: 11 pid: 14380 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602625.537830:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14380:1874436839016320:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602625.537959:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a46907480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602625.541174:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14380:1874436839016320:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602625.541221:0:14380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602625.543773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602625.544280:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821206528 00000100:00100000:0.0:1787602625.544293:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821206528 00010000:00010000:0.0:1787602625.544360:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235021f expref: 12 pid: 14380 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602625.544409:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:0.0:1787602625.544421:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+12:2361:x1874436821206528:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602625.544440:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602625.544449:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235021f expref: 12 pid: 14380 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.544487:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235021f expref: 12 pid: 14380 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.544516:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47da2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235021f expref: 12 pid: 14380 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.544537:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff944a58b88400) 00010000:00010000:0.0:1787602625.544544:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.544556:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.544566:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602625.544806:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602625.544889:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2f1bc58-39a1-4c5f-8ed9-3111442be699+11:2361:x1874436821206528:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 469us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602625.544897:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 10 00010000:00010000:1.0:1787602625.546063:0:14380:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.546078:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.546130:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.546144:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.546156:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548108:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548132:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548146:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.548160:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787602625.548195:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548202:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548210:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548217:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a5011d600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.548222:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548245:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548267:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff944a58b88400) 00010000:00010000:1.0:1787602625.548270:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.548276:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548282:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011d600/0x576b7af90af47dcc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602625.548300:0:14380:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4b37c32 reply state 00000000a5159f49 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602625.548309:0:14380:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787602625.548774:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a5011ce00/0x576b7af90af47dc5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235022d expref: 14 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548811:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235022d expref: 13 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.548820:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:1.0:1787602625.548823:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787602625.548826:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41486200, rc 0) 00000100:00100000:1.0:1787602625.548990:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+14:14437:x1874436821206400:12345-192.168.206.25@tcp:101:bash.0 Request processed in 11611us (12722us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787602625.549000:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 28 00010000:00010000:1.0:1787602625.552991:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.553030:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.553066:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.553073:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487200 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602625.553080:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.553090:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.553112:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff944a43b20700) 00010000:00010000:1.0:1787602625.553116:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602625.553121:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.553128:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47dd3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602625.565299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.566141:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821206656 00000100:00100000:1.0:1787602625.566157:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821206656 00000100:00100000:1.0:1787602625.566237:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 29 00000100:00100000:1.0:1787602625.566249:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+13:14437:x1874436821206656:12345-192.168.206.25@tcp:101:bash.0 00010000:00010000:1.0:1787602625.566281:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602625.566306:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47de8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350234 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.566500:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.566517:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.566530:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.566581:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787602625.568861:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602625.570026:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.570536:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.570864:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47de8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350234 expref: 15 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.570905:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350234 expref: 14 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.570917:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:1.0:1787602625.570920:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602625.570924:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487c00, rc 0) 00000100:00100000:1.0:1787602625.572171:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+14:14437:x1874436821206656:12345-192.168.206.25@tcp:101:bash.0 Request processed in 5914us (6878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602625.572186:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 29 00000100:00100000:3.0:1787602625.576410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602625.577153:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821206912 00000100:00100000:0.0:1787602625.577168:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821206912 00000100:00100000:0.0:1787602625.577279:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:0.0:1787602625.577292:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d743acf-bd40-44c9-89fb-11535243145c+14:14437:x1874436821206912:12345-192.168.206.25@tcp:35:bash.0 00000100:00100000:0.0:1787602625.578510:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d743acf-bd40-44c9-89fb-11535243145c+15:14437:x1874436821206912:12345-192.168.206.25@tcp:35:bash.0 Request processed in 1213us (2106us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787602625.578523:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 5 00000040:00080000:0.0:1787602625.630358:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787602625.674815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.674951:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821207168 00000100:00100000:1.0:1787602625.674964:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821207168 00000100:00100000:1.0:1787602625.675114:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 30 00000100:00100000:1.0:1787602625.675128:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+15:14447:x1874436821207168:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602625.675160:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602625.675187:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47df6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235023b expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.675334:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787602625.675497:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47df6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235023b expref: 17 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.675514:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff944a48ace500) 00010000:00010000:1.0:1787602625.675517:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602625.675523:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47df6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235023b expref: 17 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.675543:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487200, rc 0) 00000100:00100000:1.0:1787602625.675610:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+16:14447:x1874436821207168:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 485us (809us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787602625.675618:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 30 00000100:00100000:3.0:1787602625.682317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.682471:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821207424 00000100:00100000:1.0:1787602625.682484:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821207424 00000100:00100000:1.0:1787602625.682556:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:1.0:1787602625.682570:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d743acf-bd40-44c9-89fb-11535243145c+16:14447:x1874436821207424:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:1.0:1787602625.682937:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d743acf-bd40-44c9-89fb-11535243145c+17:14447:x1874436821207424:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 369us (631us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787602625.682968:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:0.0:1787602625.744395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.744576:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821207680 00000100:00100000:1.0:1787602625.744590:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821207680 00000100:00100000:1.0:1787602625.744667:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 31 00000100:00100000:1.0:1787602625.744680:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+17:14450:x1874436821207680:12345-192.168.206.25@tcp:101:lfs.0 00010000:00010000:1.0:1787602625.744711:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602625.744739:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47e04 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350242 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.744879:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47e0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.744896:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47e0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.744909:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47e0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602625.744923:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787602625.745157:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487200/0x576b7af90af47e04 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350242 expref: 20 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.745198:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47e0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350242 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602625.745209:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:1.0:1787602625.745213:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602625.745217:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41486800, rc 0) 00000100:00100000:1.0:1787602625.745303:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+19:14450:x1874436821207680:12345-192.168.206.25@tcp:101:lfs.0 Request processed in 625us (921us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787602625.745311:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 31 00000100:00100000:3.0:1787602625.763009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602625.764242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602625.764963:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821207808 00000100:00100000:2.0:1787602625.764977:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821207808 00000100:00100000:2.0:1787602625.765090:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 32 00000100:00100000:2.0:1787602625.765103:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+19:14450:x1874436821207808:12345-192.168.206.25@tcp:54:lfs.0 00010000:00010000:2.0:1787602625.765201:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602625.765222:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602625.765236:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602625.765278:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602625.765286:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e19 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602625.765295:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602625.765761:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610aa00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:2.0:1787602625.765766:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602625.765775:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602625.765821:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:2.0:1787602625.765824:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602625.765830:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e19 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602625.765837:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602625.765952:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+19:14450:x1874436821207808:12345-192.168.206.25@tcp:54:lfs.0 Request processed in 849us (2956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602625.765962:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 32 00000100:00100000:3.0:1787602625.767951:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821207936 00000100:00100000:3.0:1787602625.767968:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821207936 00000100:00100000:3.0:1787602625.768687:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:3.0:1787602625.768704:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d743acf-bd40-44c9-89fb-11535243145c+19:2362:x1874436821207936:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602625.768725:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602625.768755:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47e0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350242 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602625.768780:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:3.0:1787602625.768796:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602625.768879:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d743acf-bd40-44c9-89fb-11535243145c+18:2362:x1874436821207936:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 181us (4644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602625.768888:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:0.0:1787602625.770636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602625.770798:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821208192 00000100:00100000:1.0:1787602625.770810:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821208192 00000100:00100000:1.0:1787602625.770893:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:1.0:1787602625.770904:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d743acf-bd40-44c9-89fb-11535243145c+18:14450:x1874436821208192:12345-192.168.206.25@tcp:35:lfs.0 00000100:00100000:1.0:1787602625.771556:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d743acf-bd40-44c9-89fb-11535243145c+19:14450:x1874436821208192:12345-192.168.206.25@tcp:35:lfs.0 Request processed in 651us (930us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787602625.771565:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:1.0:1787602626.036552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.036751:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821208448 00000100:00100000:0.0:1787602626.036764:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821208448 00000100:00100000:0.0:1787602626.036900:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:0.0:1787602626.036924:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+19:14481:x1874436821208448:12345-192.168.206.25@tcp:101:cat.0 00010000:00010000:0.0:1787602626.036966:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602626.036994:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e20 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350249 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.037726:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e27 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.037763:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.037807:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e27 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602626.037834:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787602626.038131:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e20 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350249 expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.038166:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e27 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350249 expref: 21 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.038178:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602626.038395:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602626.038400:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a7c459400, rc 0) 00000100:00100000:0.0:1787602626.038640:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+21:14481:x1874436821208448:12345-192.168.206.25@tcp:101:cat.0 Request processed in 1715us (2100us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787602626.038649:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 33 00000100:00100000:3.0:1787602626.046631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.046704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.046820:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821208576 00000100:00100000:2.0:1787602626.046828:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821208832 00000100:00100000:2.0:1787602626.046833:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821208832 00000100:00100000:0.0:1787602626.046833:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821208576 00000100:00100000:0.0:1787602626.046912:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:0.0:1787602626.046925:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d743acf-bd40-44c9-89fb-11535243145c+22:2363:x1874436821208576:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602626.046943:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787602626.046956:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:2.0:1787602626.046965:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d743acf-bd40-44c9-89fb-11535243145c+22:14481:x1874436821208832:12345-192.168.206.25@tcp:35:cat.0 00010000:00010000:0.0:1787602626.046974:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e27 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350249 expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.046996:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602626.047001:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602626.047103:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d743acf-bd40-44c9-89fb-11535243145c+21:2363:x1874436821208576:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 180us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.047110:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:2.0:1787602626.047391:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d743acf-bd40-44c9-89fb-11535243145c+21:14481:x1874436821208832:12345-192.168.206.25@tcp:35:cat.0 Request processed in 427us (686us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787602626.047398:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:3.0:1787602626.115616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602626.116846:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821209088 00000100:00100000:2.0:1787602626.116864:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821209088 00000100:00100000:2.0:1787602626.116951:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 34 00000100:00100000:2.0:1787602626.116964:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+21:14487:x1874436821209088:12345-192.168.206.25@tcp:101:dd.0 00010000:00010000:2.0:1787602626.116996:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602626.117022:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e35 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350250 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.117218:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.117255:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235022d expref: 22 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.117264:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350234 expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.117273:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.117319:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350234 expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.117335:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350234 expref: 22 pid: 14379 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602626.117350:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c837100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14378:1874436839016448:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602626.117478:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235022d expref: 22 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.117489:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235022d expref: 22 pid: 14380 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602626.117499:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c835880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14378:1874436839016576:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602626.117521:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a488bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602626.121092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.121152:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821209216 00000100:00100000:0.0:1787602626.121174:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821209216 00010000:00010000:0.0:1787602626.121240:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350234 expref: 23 pid: 14379 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.121294:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:0.0:1787602626.121306:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9449450cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d743acf-bd40-44c9-89fb-11535243145c+23:2361:x1874436821209216:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602626.121324:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602626.121332:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350234 expref: 23 pid: 14379 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.121365:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350234 expref: 23 pid: 14379 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.121392:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602626.121397:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.121407:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.121413:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602626.121478:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9449450cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d743acf-bd40-44c9-89fb-11535243145c+23:2361:x1874436821209216:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 174us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.121486:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:3.0:1787602626.121929:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00010000:00010000:2.0:1787602626.121988:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47def lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350234 expref: 22 pid: 14379 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602626.122028:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c837100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14378:1874436839016448:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602626.122085:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c835880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14378:1874436839016576:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602626.122111:0:14378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.122178:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821209344 00000100:00100000:0.0:1787602626.122760:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821209344 00010000:00010000:0.0:1787602626.122807:0:14365:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235022d expref: 22 pid: 14380 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.122852:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 12 00000100:00100000:0.0:1787602626.122861:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d743acf-bd40-44c9-89fb-11535243145c+22:2361:x1874436821209344:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602626.122874:0:14365:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602626.122881:0:14365:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235022d expref: 22 pid: 14380 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.122894:0:14365:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235022d expref: 22 pid: 14380 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.122928:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486200/0x576b7af90af47dda lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235022d expref: 22 pid: 14380 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.122943:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602626.122949:0:14365:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.122959:0:14365:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.122967:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.122998:0:14365:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602626.123086:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d743acf-bd40-44c9-89fb-11535243145c+21:2361:x1874436821209344:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 226us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.123095:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 12 00010000:00010000:2.0:1787602626.123577:0:14378:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.123588:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602626.123613:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787602626.123832:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e35 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350250 expref: 22 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.123851:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94494610b200/0x576b7af90af47e3c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350250 expref: 21 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.123860:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:2.0:1787602626.123863:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787602626.123866:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94494610b200, rc 0) 00000100:00100000:2.0:1787602626.123918:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+21:14487:x1874436821209088:12345-192.168.206.25@tcp:101:dd.0 Request processed in 6957us (8317us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787602626.123926:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 34 00000100:00100000:0.0:1787602626.133916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602626.141492:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821209600 00000100:00100000:1.0:1787602626.141512:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821209600 00000100:00100000:1.0:1787602626.141701:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 35 00000100:00100000:1.0:1787602626.141715:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+21:14487:x1874436821209600:12345-192.168.206.25@tcp:36:dd.0 00010000:00010000:1.0:1787602626.142110:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.142132:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.142146:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602626.142224:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787602626.142270:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d4860f6 reply state 0000000009df4a7a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602626.142281:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602626.142434:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+24:14487:x1874436821209600:12345-192.168.206.25@tcp:36:dd.0 Request processed in 720us (8533us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787602626.142443:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 35 00000020:00080000:1.0:1787602626.142449:0:14379:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602626.150461:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.150483:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.150493:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.150500:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41486c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602626.150506:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.150515:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.150536:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:3.0:1787602626.150540:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602626.150545:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.150552:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486c00/0x576b7af90af47e4a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.153706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602626.153821:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821209728 00000100:00100000:2.0:1787602626.153835:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821209728 00000100:00100000:2.0:1787602626.153923:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00100000:2.0:1787602626.153936:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+23:14487:x1874436821209728:12345-192.168.206.25@tcp:101:dd.0 00010000:00010000:2.0:1787602626.153969:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602626.153996:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e51 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350257 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.154115:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e51 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350257 expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.154134:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e51 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350257 expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.154169:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:2.0:1787602626.154173:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602626.154179:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94494610aa00, rc 0) 00000100:00100000:2.0:1787602626.154255:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+24:14487:x1874436821209728:12345-192.168.206.25@tcp:101:dd.0 Request processed in 321us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602626.154263:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 36 00000100:00100000:0.0:1787602626.176698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602626.176903:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821209984 00000100:00100000:1.0:1787602626.176915:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821209984 00000100:00100000:1.0:1787602626.176996:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:1.0:1787602626.177009:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d743acf-bd40-44c9-89fb-11535243145c+24:14487:x1874436821209984:12345-192.168.206.25@tcp:103:dd.0 00010000:00010000:1.0:1787602626.177026:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602626.177102:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94494610aa00/0x576b7af90af47e51 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350257 expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.177125:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:1.0:1787602626.177131:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602626.177445:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d743acf-bd40-44c9-89fb-11535243145c+23:14487:x1874436821209984:12345-192.168.206.25@tcp:103:dd.0 Request processed in 438us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602626.177454:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:0.0:1787602626.180525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602626.182430:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821210112 00000100:00100000:1.0:1787602626.182449:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821210112 00000100:00100000:1.0:1787602626.182554:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 37 00000100:00100000:1.0:1787602626.182567:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+23:14487:x1874436821210112:12345-192.168.206.25@tcp:58:dd.0 00010000:00010000:1.0:1787602626.182695:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.182717:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.182731:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602626.183856:0:14379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602626.184029:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787602626.184510:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787602626.184708:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+23:14487:x1874436821210112:12345-192.168.206.25@tcp:58:dd.0 Request processed in 2137us (4189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602626.184722:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 37 00000100:00100000:0.0:1787602626.199549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.199677:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821210240 00000100:00100000:3.0:1787602626.199690:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821210240 00000100:00100000:3.0:1787602626.199764:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 38 00000100:00100000:3.0:1787602626.199806:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+23:14487:x1874436821210240:12345-192.168.206.25@tcp:101:dd.0 00010000:00010000:3.0:1787602626.199833:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602626.199859:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47e5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235025e expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.199934:0:14380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.199947:0:14380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47e5f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235025e expref: 24 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.199970:0:14380:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.199984:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47e5f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235025e expref: 24 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.200001:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:3.0:1787602626.200005:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602626.200009:0:14380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47e5f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235025e expref: 24 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.200018:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71a00, rc 0) 00000100:00100000:3.0:1787602626.200126:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+24:14487:x1874436821210240:12345-192.168.206.25@tcp:101:dd.0 Request processed in 323us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602626.200135:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 38 00010000:00010000:0.0:1787602626.269422:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602626.309159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.309298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.309328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.309373:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602626.309513:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821210624 00000100:00100000:1.0:1787602626.309526:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821210624 00000100:00100000:1.0:1787602626.309597:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821210880 00000100:00100000:1.0:1787602626.309600:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821210880 00000100:00100000:1.0:1787602626.309613:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821210496 00000100:00100000:1.0:1787602626.309615:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821210496 00000100:00100000:1.0:1787602626.309631:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00100000:1.0:1787602626.309641:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d743acf-bd40-44c9-89fb-11535243145c+5:2361:x1874436821210624:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602626.309754:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:0.0:1787602626.309794:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2f1bc58-39a1-4c5f-8ed9-3111442be699+5:2361:x1874436821210880:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:3.0:1787602626.309873:0:15065:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787602626.309884:0:15065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1787602626.310027:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:3.0:1787602626.310059:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d743acf-bd40-44c9-89fb-11535243145c+5:2361:x1874436821210496:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:2.0:1787602626.310342:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821210368 00000100:00100000:2.0:1787602626.310349:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821210368 00000100:00100000:2.0:1787602626.310396:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 120 00000100:00100000:2.0:1787602626.310405:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:2361:x1874436821210368:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:1.0:1787602626.310607:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d743acf-bd40-44c9-89fb-11535243145c+5:2361:x1874436821210624:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 962us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602626.310616:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 8 00000100:00080000:1.0:1787602626.310649:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602626.310655:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602626.310721:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d2f1bc58-39a1-4c5f-8ed9-3111442be699+5:2361:x1874436821210880:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 941us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.310730:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:0.0:1787602626.310804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.310884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.310955:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821211008 00000100:00100000:0.0:1787602626.310960:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821211008 00000100:00100000:0.0:1787602626.310998:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:0.0:1787602626.311004:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2f1bc58-39a1-4c5f-8ed9-3111442be699+5:2361:x1874436821211008:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602626.311049:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d2f1bc58-39a1-4c5f-8ed9-3111442be699+5:2361:x1874436821211008:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 30us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.311055:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00080000:0.0:1787602626.311074:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602626.311113:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821210752 00000100:00100000:0.0:1787602626.311116:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821210752 00000100:00100000:0.0:1787602626.311153:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 22 00000100:00100000:0.0:1787602626.311160:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944947b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+11:2361:x1874436821210752:12345-192.168.206.25@tcp:400:kworker.0 00000100:00100000:0.0:1787602626.311199:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d2f1bc58-39a1-4c5f-8ed9-3111442be699+11:2361:x1874436821210752:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 40us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.311206:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 22 00000100:00100000:3.0:1787602626.312291:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944947b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d743acf-bd40-44c9-89fb-11535243145c+5:2361:x1874436821210496:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 2247us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602626.312305:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:2.0:1787602626.312824:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea071c-5555-42cd-ad4f-55bb895c26a4+13:2361:x1874436821210368:12345-192.168.206.25@tcp:400:kworker.0 Request processed in 2415us (3674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602626.312836:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 120 00000040:00080000:0.0:1787602626.653496:0:14411:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787602626.653507:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787602626.653552:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787602626.653561:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787602626.653717:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14411:1874436839016704:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787602626.653954:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a506cdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602626.659008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.659474:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821211136 00000100:00100000:3.0:1787602626.659488:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821211136 00000100:00100000:3.0:1787602626.659553:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:3.0:1787602626.659566:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4d743acf-bd40-44c9-89fb-11535243145c+25:14489:x1874436821211136:12345-192.168.206.25@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787602626.659853:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4d743acf-bd40-44c9-89fb-11535243145c+25:14489:x1874436821211136:12345-192.168.206.25@tcp:900:lhsmtool_posix.0 Request processed in 289us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602626.659862:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:0.0:1787602626.659970:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c2d1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14411:1874436839016704:192.168.206.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787602626.670687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.670940:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821211264 00000100:00100000:3.0:1787602626.670952:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821211264 00000100:00100000:3.0:1787602626.671024:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:3.0:1787602626.671054:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+24:14489:x1874436821211264:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787602626.671125:0:14378:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787602626.671264:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+24:14489:x1874436821211264:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 230us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602626.671272:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 39 00000100:00100000:3.0:1787602626.674399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.675247:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821211392 00000100:00100000:0.0:1787602626.675265:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821211392 00000100:00100000:0.0:1787602626.675349:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 40 00000100:00100000:0.0:1787602626.675363:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+24:14489:x1874436821211392:12345-192.168.206.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787602626.675465:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e66 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675486:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e66 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675500:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e66 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675655:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47e6d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675678:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47e6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675691:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47e6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675722:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675731:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675743:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602626.675812:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787602626.675816:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602626.675826:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675836:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e66 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675895:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e66 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675901:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e66 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675906:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458e00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602626.675910:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e66 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675916:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e66 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675927:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48ace700) 00010000:00010000:0.0:1787602626.675930:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602626.675933:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e66 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675938:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458e00/0x576b7af90af47e66 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675951:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47e6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675965:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47e6d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675970:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47e6d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675973:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602626.675976:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47e6d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675980:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47e6d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675986:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff944a48ace400) 00010000:00010000:0.0:1787602626.675987:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602626.675989:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47e6d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.675994:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c458400/0x576b7af90af47e6d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.676009:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.676014:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.676019:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.676023:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602626.676031:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.676173:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.676181:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602626.676183:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602626.676185:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.676190:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459400/0x576b7af90af47e74 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.676275:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+24:14489:x1874436821211392:12345-192.168.206.25@tcp:34:lhsmtool_posix.0 Request processed in 912us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.676282:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 40 00000100:00100000:1.0:1787602626.679714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.679893:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821211648 00000100:00100000:3.0:1787602626.679906:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821211648 00000100:00100000:1.0:1787602626.681688:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 41 00000100:00100000:1.0:1787602626.681716:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+24:14489:x1874436821211648:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602626.681747:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602626.681774:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486000/0x576b7af90af47e7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350265 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682170:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682189:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682203:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602626.682217:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787602626.682363:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682371:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682379:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682386:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487a00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602626.682390:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682398:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682412:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:1.0:1787602626.682415:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787602626.682421:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e82 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682560:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682623:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486000/0x576b7af90af47e7b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350265 expref: 26 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682691:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff944a48ace700) 00010000:00010000:1.0:1787602626.682694:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602626.682700:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486000/0x576b7af90af47e7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350265 expref: 26 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.682712:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41486000, rc 0) 00000100:00100000:1.0:1787602626.682808:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+25:14489:x1874436821211648:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 1105us (3106us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787602626.682816:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 41 00000100:00100000:2.0:1787602626.689414:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.689512:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821211776 00000100:00100000:0.0:1787602626.689526:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821211776 00000100:00100000:0.0:1787602626.689609:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 42 00000100:00100000:0.0:1787602626.689622:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+25:14489:x1874436821211776:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787602626.689668:0:14379:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787602626.689809:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+25:14489:x1874436821211776:12345-192.168.206.25@tcp:53:lhsmtool_posix.0 Request processed in 190us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.689818:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 42 00000100:00100000:3.0:1787602626.697904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602626.699067:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821212032 00000100:00100000:1.0:1787602626.699084:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821212032 00000100:00100000:1.0:1787602626.699289:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00100000:1.0:1787602626.699304:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+25:14489:x1874436821212032:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602626.699331:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602626.699368:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486000/0x576b7af90af47e90 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235026c expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602626.700644:0:14378:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1787602626.700876:0:14378:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787602626.700943:0:14378:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787602626.701843:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.701871:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.701885:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.701971:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486000/0x576b7af90af47e90 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235026c expref: 28 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.702464:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235026c expref: 27 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.702476:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20700) 00010000:00010000:1.0:1787602626.702479:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602626.702484:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487a00, rc 0) 00000100:00100000:1.0:1787602626.702889:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+27:14489:x1874436821212032:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 3587us (4996us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787602626.702900:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 43 00000100:00100000:1.0:1787602626.709856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.709963:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821212288 00000100:00100000:3.0:1787602626.709976:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821212288 00000100:00100000:3.0:1787602626.710509:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 44 00000100:00100000:3.0:1787602626.710524:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+27:14489:x1874436821212288:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787602626.710605:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602626.710642:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487a00/0x576b7af90af47e97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235026c expref: 27 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.710695:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20700) 00010000:00010000:3.0:1787602626.710710:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602626.710742:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ea5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.710758:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ea5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.710770:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ea5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711090:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47eac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcadd1a07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711113:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47eac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcadd1a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711125:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47eac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcadd1a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711215:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ea5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711222:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ea5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711246:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ea5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711251:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602626.711255:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ea5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711263:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ea5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711277:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff944a58b88400) 00010000:00010000:3.0:1787602626.711279:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602626.711283:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ea5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711289:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ea5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711300:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47eac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcadd1a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711305:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47eac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcadd1a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711311:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47eac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcadd1a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711315:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71600 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602626.711318:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47eac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcadd1a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711335:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47eac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcadd1a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711344:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xcadd1a07 (ffff944a58b88e00) 00010000:00010000:3.0:1787602626.711347:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602626.711350:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47eac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcadd1a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.711356:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47eac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcadd1a07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602626.711475:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+26:14489:x1874436821212288:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 951us (1636us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602626.711485:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 44 00000100:00100000:2.0:1787602626.713984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602626.714255:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821212416 00000100:00100000:1.0:1787602626.714268:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821212416 00000100:00100000:1.0:1787602626.714390:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:1.0:1787602626.714402:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a4d3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+26:14489:x1874436821212416:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602626.714429:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602626.714460:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486000/0x576b7af90af47eb3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350273 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.714530:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af47eba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.714546:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af47eba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.714559:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af47eba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.714689:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486000/0x576b7af90af47eb3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350273 expref: 28 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.714711:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487800/0x576b7af90af47eba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350273 expref: 27 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.714721:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20000) 00010000:00010000:1.0:1787602626.714724:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787602626.714728:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a41487800, rc 0) 00000100:00100000:1.0:1787602626.714859:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a4d3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+27:14489:x1874436821212416:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 459us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602626.714867:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 45 00000100:00100000:0.0:1787602626.718374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602626.719321:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821212672 00000100:00100000:1.0:1787602626.719337:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821212672 00000100:00100000:1.0:1787602626.719426:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 46 00000100:00100000:1.0:1787602626.719439:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+27:14489:x1874436821212672:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787602626.719553:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.719595:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.719610:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602626.720362:0:14380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787602626.720377:0:14380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 457826338965ns, next at 458826336215ns, rc = 0 00000004:00010000:1.0:1787602626.720488:0:14380:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd6f6c76 reply state 00000000f5853fe4 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602626.720500:0:14380:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602626.720817:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+29:14489:x1874436821212672:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 1376us (2455us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787602626.720828:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 46 00000100:00100000:2.0:1787602626.724170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00010000:00010000:1.0:1787602626.724558:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.724575:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.724584:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.724591:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41486400 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:1.0:1787602626.724596:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.724604:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.724661:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20000) 00010000:00010000:1.0:1787602626.724665:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787602626.724671:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.724677:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486400/0x576b7af90af47ec1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602626.724828:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821212800 00000100:00100000:3.0:1787602626.724840:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821212800 00000100:00100000:3.0:1787602626.724909:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00100000:3.0:1787602626.725026:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+28:14489:x1874436821212800:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602626.725186:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602626.725210:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47ec8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235027a expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.725282:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235027a expref: 29 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.725298:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235027a expref: 29 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.725450:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20000) 00010000:00010000:3.0:1787602626.725454:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602626.725457:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a47d71600, rc 0) 00000100:00100000:3.0:1787602626.725576:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+29:14489:x1874436821212800:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 555us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602626.725585:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 47 00000100:00100000:2.0:1787602626.728562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.728724:0:15842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821212928 00000100:00100000:0.0:1787602626.728737:0:15842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821212928 00000100:00100000:0.0:1787602626.728855:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:0.0:1787602626.728867:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d743acf-bd40-44c9-89fb-11535243145c+5:2362:x1874436821212928:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787602626.729694:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d743acf-bd40-44c9-89fb-11535243145c+6:2362:x1874436821212928:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 Request processed in 826us (1142us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787602626.729705:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:0.0:1787602626.732518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602626.732610:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821213184 00000100:00100000:1.0:1787602626.732623:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821213184 00000100:00100000:1.0:1787602626.732798:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:1.0:1787602626.732811:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d743acf-bd40-44c9-89fb-11535243145c+29:14489:x1874436821213184:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787602626.733302:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c2d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d743acf-bd40-44c9-89fb-11535243145c+30:14489:x1874436821213184:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 491us (796us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787602626.733312:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 9 00000100:00100000:3.0:1787602626.735360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.735594:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821213440 00000100:00100000:0.0:1787602626.735606:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821213440 00000100:00100000:0.0:1787602626.735687:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 48 00000100:00100000:0.0:1787602626.735699:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+30:14489:x1874436821213440:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787602626.735842:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+30:14489:x1874436821213440:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 144us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.735850:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 48 00000100:00100000:0.0:1787602626.738176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.738389:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821213568 00000100:00100000:3.0:1787602626.738401:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821213568 00000100:00100000:3.0:1787602626.738469:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:3.0:1787602626.738480:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+30:14489:x1874436821213568:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602626.738503:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602626.738529:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ecf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350281 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.738612:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af47ed6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.738629:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af47ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.738655:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af47ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602626.738700:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602626.738724:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af47ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.738792:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ecf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350281 expref: 32 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.738814:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af47ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350281 expref: 31 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.738823:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20000) 00010000:00010000:3.0:1787602626.738827:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787602626.738831:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a40031000, rc 0) 00000100:00100000:3.0:1787602626.738896:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+31:14489:x1874436821213568:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 418us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602626.738904:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 49 00000100:00100000:0.0:1787602626.741749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.741903:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821213696 00000100:00100000:3.0:1787602626.741984:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821213696 00000100:00100000:3.0:1787602626.742071:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:3.0:1787602626.742085:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d743acf-bd40-44c9-89fb-11535243145c+6:2363:x1874436821213696:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602626.742107:0:15064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602626.742131:0:15064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e0e7df1/0x576b7af90af47edd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab12350288 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602626.742167:0:15064:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ca6c1, blocks: 0x1 00010000:00010000:3.0:1787602626.742189:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787602626.742194:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602626.742204:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e0e7df1/0x576b7af90af47edd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350288 expref: 7 pid: 15064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.742248:0:15064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e0e7df1/0x576b7af90af47edd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350288 expref: 7 pid: 15064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.742263:0:15064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff944a40031a00, rc 0) 00000100:00100000:3.0:1787602626.744384:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d743acf-bd40-44c9-89fb-11535243145c+7:2363:x1874436821213696:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 251us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602626.744413:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:0.0:1787602626.745177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602626.745280:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821213952 00000100:00100000:1.0:1787602626.745292:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821213952 00000100:00100000:1.0:1787602626.745413:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 50 00000100:00100000:1.0:1787602626.745426:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+31:14489:x1874436821213952:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787602626.745600:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+31:14489:x1874436821213952:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 176us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602626.745608:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 50 00000100:00100000:0.0:1787602626.748299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.748452:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821214080 00000100:00100000:3.0:1787602626.748465:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821214080 00000100:00100000:3.0:1787602626.748534:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00100000:3.0:1787602626.748546:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+31:14489:x1874436821214080:12345-192.168.206.25@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787602626.786575:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:0.0:1787602626.786594:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1787602626.786601:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787602626.786610:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787602626.786834:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436839016832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787602626.787110:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602626.787200:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839016832 00000100:00100000:0.0:1787602626.787209:0:15065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839016832 00000100:00100000:0.0:1787602626.787274:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602626.787285:0:15065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874436839016832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787602626.787552:0:15065:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787602626.787571:0:15065:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787602626.787574:0:15065:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787602626.787576:0:15065:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787602625 -> 1787602625 00002000:00010000:0.0:1787602626.787579:0:15065:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787602626.787631:0:15065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874436839016832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 347us (522us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787602626.787640:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787602626.787664:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787602626.787704:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff944a7c484700/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787602626.787711:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436839016832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787602626.788102:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d743acf-bd40-44c9-89fb-11535243145c+14:14489:x1874436821214080:12345-192.168.206.25@tcp:44:lhsmtool_posix.0 Request processed in 39554us (39811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602626.788113:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 51 00000100:00100000:1.0:1787602626.790912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.791191:0:15842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821214208 00000100:00100000:0.0:1787602626.791204:0:15842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821214208 00000100:00100000:0.0:1787602626.791315:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:0.0:1787602626.791330:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d743acf-bd40-44c9-89fb-11535243145c+7:2362:x1874436821214208:12345-192.168.206.25@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787602626.791479:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d743acf-bd40-44c9-89fb-11535243145c+7:2362:x1874436821214208:12345-192.168.206.25@tcp:16:lhsmtool_posix.0 Request processed in 152us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.791487:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:0.0:1787602626.793834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.793994:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821214464 00000100:00100000:3.0:1787602626.794005:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821214464 00000100:00100000:3.0:1787602626.794115:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 52 00000100:00100000:3.0:1787602626.794127:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+14:14489:x1874436821214464:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787602626.794199:0:14378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602626.794233:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a40031000/0x576b7af90af47ed6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350281 expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.794260:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20000) 00010000:00010000:3.0:1787602626.794266:0:14378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602626.794305:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.794320:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.794418:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602626.794738:0:14378:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecad324d reply state 00000000f911d5c4 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602626.794749:0:14378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602626.794887:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d743acf-bd40-44c9-89fb-11535243145c+15:14489:x1874436821214464:12345-192.168.206.25@tcp:36:lhsmtool_posix.0 Request processed in 760us (1062us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787602626.794895:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 52 00010000:00010000:3.0:1787602626.798127:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.798152:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.798160:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.798167:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:3.0:1787602626.798173:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.798181:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.798202:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20000) 00010000:00010000:3.0:1787602626.798205:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602626.798211:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.798239:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71800/0x576b7af90af47ee4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.799254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602626.799445:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821214592 00000100:00100000:2.0:1787602626.799460:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821214592 00000100:00100000:2.0:1787602626.799536:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00100000:2.0:1787602626.799550:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d743acf-bd40-44c9-89fb-11535243145c+7:14489:x1874436821214592:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602626.799574:0:15064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602626.799598:0:15064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51ae90ab1235028f expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.799711:0:15064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e0e7df1/0x576b7af90af47edd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350288 expref: 8 pid: 15064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.799723:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602626.799728:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602626.799734:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 8 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.799789:0:15064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e0e7df1/0x576b7af90af47edd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350288 expref: 8 pid: 15064 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.799807:0:15064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e0e7df1/0x576b7af90af47edd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350288 expref: 8 pid: 15064 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602626.799824:0:15064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15064:1874436839016960:192.168.206.25@tcp:104: 00000100:00100000:2.0:1787602626.800070:0:15064:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4693d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787602626.802365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.802542:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821214720 00000100:00100000:0.0:1787602626.802553:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821214720 00010000:00010000:0.0:1787602626.802679:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e0e7df1/0x576b7af90af47edd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350288 expref: 9 pid: 15064 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.802727:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 13 00000100:00100000:2.0:1787602626.802732:0:15064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15064:1874436839016960:192.168.206.25@tcp:104: 00000100:00100000:0.0:1787602626.802737:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d743acf-bd40-44c9-89fb-11535243145c+9:2362:x1874436821214720:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602626.802769:0:15064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 9 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.802772:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602626.802800:0:15064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94494610a800, rc 0) 00000100:00100000:2.0:1787602626.802872:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d743acf-bd40-44c9-89fb-11535243145c+9:14489:x1874436821214592:12345-192.168.206.25@tcp:101:lhsmtool_posix.0 Request processed in 3325us (3962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602626.802881:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 14 00010000:00010000:0.0:1787602626.803912:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e0e7df1/0x576b7af90af47edd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350288 expref: 9 pid: 15064 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.803944:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e0e7df1/0x576b7af90af47edd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350288 expref: 8 pid: 15064 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.803975:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e0e7df1/0x576b7af90af47edd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab12350288 expref: 8 pid: 15064 timeout: 557 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.804284:0:14363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602626.804292:0:14363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602626.804301:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 7 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.804313:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 7 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.804369:0:14363:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 7 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.805069:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c485500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14363:1874436839017088:192.168.206.25@tcp:105: 00000100:00100000:0.0:1787602626.805260:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a479620c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602626.812772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602626.815264:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821214848 00000100:00100000:2.0:1787602626.815280:0:15063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821214848 00000100:00100000:2.0:1787602626.815374:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:2.0:1787602626.815387:0:15063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d743acf-bd40-44c9-89fb-11535243145c+8:2361:x1874436821214848:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787602626.815406:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c485500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14363:1874436839017088:192.168.206.25@tcp:105: 00010000:00010000:0.0:1787602626.815434:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602626.815517:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d743acf-bd40-44c9-89fb-11535243145c+8:2362:x1874436821214720:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 12780us (13168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.815527:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 13 00002000:00010000:2.0:1787602626.815900:0:15063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787602626.815905:0:15063:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787602625 00002000:00010000:2.0:1787602626.815908:0:15063:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787602624 00002000:00010000:2.0:1787602626.815910:0:15063:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787602625 -> 1787602625 00002000:00010000:2.0:1787602626.815912:0:15063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787602626.815996:0:15063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d743acf-bd40-44c9-89fb-11535243145c+8:2361:x1874436821214848:12345-192.168.206.25@tcp:2:lhsmtool_posix.0 Request processed in 611us (3236us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787602626.816004:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:1.0:1787602626.822944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.830813:0:15842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821214976 00000100:00100000:0.0:1787602626.830834:0:15842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821214976 00000100:00100000:1.0:1787602626.831103:0:15842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:1.0:1787602626.831117:0:15842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d743acf-bd40-44c9-89fb-11535243145c+8:2364:x1874436821214976:12345-192.168.206.25@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787602626.831190:0:15842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.831219:0:15842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 8 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.831229:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602626.831238:0:15842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602626.831244:0:15842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.831475:0:15842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 8 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.831492:0:15842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 8 pid: 15064 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602626.831510:0:15842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e9a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15842:1874436839017216:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602626.831637:0:15842:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a42dbb900 going to sleep for 11 seconds 00000100:00100000:2.0:1787602626.835516:0:15842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e9a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15842:1874436839017216:192.168.206.25@tcp:104: 00010000:00010000:2.0:1787602626.835559:0:15842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602626.835772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602626.836527:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821215104 00000100:00100000:2.0:1787602626.836539:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821215104 00010000:00010000:2.0:1787602626.836588:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 9 pid: 15064 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602626.836636:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00100000:2.0:1787602626.836648:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d743acf-bd40-44c9-89fb-11535243145c+9:2361:x1874436821215104:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602626.836666:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602626.836693:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 9 pid: 15064 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.836707:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 9 pid: 15064 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.836734:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031a3eae1/0x576b7af90af47eeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235028f expref: 9 pid: 15064 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.836753:0:14364:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602626.836757:0:14364:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602626.836763:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.836785:0:14364:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.836845:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602626.837300:0:15842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.837324:0:15842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.837428:0:15842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.837439:0:15842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.837448:0:15842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.837456:0:15842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41486200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602626.837461:0:15842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.837470:0:15842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.837488:0:15842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.837496:0:15842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b4c02a3/0x576b7af90af47ef2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602626.837947:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d743acf-bd40-44c9-89fb-11535243145c+8:2361:x1874436821215104:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 1295us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602626.837958:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 14 00000100:00100000:1.0:1787602626.838063:0:15842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d743acf-bd40-44c9-89fb-11535243145c+7:2364:x1874436821214976:12345-192.168.206.25@tcp:1:lhsmtool_posix.0 Request processed in 6948us (15131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602626.838072:0:15842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 16 00000100:00100000:1.0:1787602626.840656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602626.840729:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821215360 00000100:00100000:3.0:1787602626.840741:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821215360 00000100:00100000:1.0:1787602626.840901:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 53 00000100:00100000:1.0:1787602626.840915:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+14:14489:x1874436821215360:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787602626.841021:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47ef9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.841068:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.841082:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.841569:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.841585:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47ec8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235027a expref: 15 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.841594:0:14379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.841748:0:14379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235027a expref: 15 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.841768:0:14379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235027a expref: 15 pid: 14378 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602626.841805:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a6e948700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14379:1874436839017344:192.168.206.25@tcp:104: 00000100:00100000:1.0:1787602626.841977:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a42dbb240 going to sleep for 11 seconds 00000100:00100000:3.0:1787602626.842070:0:14380:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787602626.842080:0:14380:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787602626.850361:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a6e948700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14379:1874436839017344:192.168.206.25@tcp:104: 00010000:00010000:1.0:1787602626.850532:0:14379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602626.859902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602626.860263:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821215488 00000100:00100000:0.0:1787602626.860704:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821215488 00010000:00010000:0.0:1787602626.860770:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235027a expref: 16 pid: 14378 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.861098:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 15 00000100:00100000:0.0:1787602626.861113:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d743acf-bd40-44c9-89fb-11535243145c+16:2362:x1874436821215488:12345-192.168.206.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602626.861202:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602626.861212:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235027a expref: 16 pid: 14378 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.861229:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235027a expref: 16 pid: 14378 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.861258:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71600/0x576b7af90af47ec8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235027a expref: 16 pid: 14378 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.861290:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20000) 00010000:00010000:0.0:1787602626.861295:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.861306:0:14363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.861345:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.861503:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602626.861588:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d743acf-bd40-44c9-89fb-11535243145c+15:2362:x1874436821215488:12345-192.168.206.25@tcp:103:ldlm_bl.0 Request processed in 477us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602626.861597:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 15 00010000:00010000:1.0:1787602626.863941:0:14379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602626.863966:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602626.864334:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787602626.864525:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787602626.864579:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787602626.864688:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14379:1874436839017472:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787602626.867052:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602626.867540:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4693d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602626.867669:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839017472 00000100:00100000:1.0:1787602626.867686:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839017472 00000100:00100000:1.0:1787602626.867733:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602626.867742:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14379:x1874436839017472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787602626.867875:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14379:x1874436839017472:12345-0@lo:1000:mdt00_001.0 Request processed in 134us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602626.867882:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602626.868089:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14379:1874436839017472:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787602626.868942:0:14379:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787602626.869022:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14379:1874436839017600:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787602626.869092:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602626.869112:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a4693d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787602626.869521:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839017600 00000100:00100000:1.0:1787602626.869528:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839017600 00000100:00100000:1.0:1787602626.869569:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602626.869577:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14379:x1874436839017600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787602626.869757:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14379:x1874436839017600:12345-0@lo:1000:mdt00_001.0 Request processed in 181us (664us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787602626.869784:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602626.869960:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14379:1874436839017600:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787602626.869998:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870008:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870015:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870021:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41486800 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602626.870026:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870033:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870080:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20000) 00010000:00010000:0.0:1787602626.870083:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602626.870088:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870104:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41486800/0x576b7af90af47f00 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870134:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870141:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870146:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870151:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487000 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602626.870155:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870161:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870170:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602626.870173:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602626.870180:0:14379:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47e5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235025e expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870191:0:14379:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47e5f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235025e expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870199:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47e5f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235025e expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.870266:0:14379:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff944a47d71a00/0x576b7af90af47e5f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.25@tcp remote: 0x51ae90ab1235025e expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.870278:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c485500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14379:1874436839017728:192.168.206.25@tcp:105: 00000100:00100000:0.0:1787602626.870339:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff944a467913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602626.876261:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c485500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14379:1874436839017728:192.168.206.25@tcp:105: 00010000:00010000:0.0:1787602626.876292:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876302:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487000/0x576b7af90af47e58 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876333:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47f07 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876346:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47f07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876356:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47f07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876366:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47f07 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876373:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47f07 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876380:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47f07 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876401:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602626.876405:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47f07 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876412:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47f07 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876423:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602626.876425:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602626.876429:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47f07 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876434:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a7c459c00/0x576b7af90af47f07 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876443:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876448:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47ef9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876455:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47ef9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876460:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487c00 already unused, calling callback (ffffffffc21084f0) 00010000:00010000:0.0:1787602626.876462:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47ef9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876468:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47ef9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876484:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff944a43b20900) 00010000:00010000:0.0:1787602626.876486:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787602626.876489:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47ef9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602626.876494:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff944a41487c00/0x576b7af90af47ef9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602626.877518:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d743acf-bd40-44c9-89fb-11535243145c+18:14489:x1874436821215360:12345-192.168.206.25@tcp:57:lhsmtool_posix.0 Request processed in 36602us (36870us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787602626.877529:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 53 00000020:00080000:0.0:1787602626.877534:0:14379:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787602626.877709:0:14411:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787602626.877714:0:14411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602626.877753:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787602626.877758:0:14411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787602626.879265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602626.879344:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821215616 00000100:00100000:2.0:1787602626.879353:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821215616 00000100:00100000:2.0:1787602626.879404:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:2.0:1787602626.879413:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7be57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d743acf-bd40-44c9-89fb-11535243145c+18:14487:x1874436821215616:12345-192.168.206.25@tcp:49:dd.0 00000100:00100000:2.0:1787602626.879750:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7be57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d743acf-bd40-44c9-89fb-11535243145c+18:14487:x1874436821215616:12345-192.168.206.25@tcp:49:dd.0 Request processed in 334us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602626.879758:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 10 00000100:00100000:1.0:1787602626.881501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602626.881580:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821215872 00000100:00100000:2.0:1787602626.881600:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821215872 00000100:00100000:2.0:1787602626.881647:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 11 00000100:00100000:2.0:1787602626.881656:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d743acf-bd40-44c9-89fb-11535243145c+18:14489:x1874436821215872:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787602626.882420:0:14382:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787602626.882520:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787602626.882561:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.882577:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.882586:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.882593:0:14382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.882600:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.882606:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602626.882632:0:14382:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602626.882832:0:14367:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602626.882839:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.882846:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610a200 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:3.0:1787602626.882850:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.882858:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.882870:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff944a43b20000) 00010000:00010000:3.0:1787602626.882873:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787602626.882878:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.882883:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94494610a200/0x576b7af90af47f0e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602626.882893:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602626.882894:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602626.882896:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602626.883001:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d743acf-bd40-44c9-89fb-11535243145c+20:14489:x1874436821215872:12345-192.168.206.25@tcp:35:lhsmtool_posix.0 Request processed in 1344us (1503us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787602626.883010:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 11 00000020:00080000:2.0:1787602626.883014:0:14382:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787602627.101558:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436839017984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602627.101621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602627.101862:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602627.101872:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a752d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436839017856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602627.101904:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602627.101942:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839017984 00000100:00100000:1.0:1787602627.101948:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839017984 00000100:00100000:3.0:1787602627.102079:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839018112:0@lo:400:kworker.0 00000100:00100000:3.0:1787602627.102112:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602627.102162:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839017856 00000100:00100000:2.0:1787602627.102167:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839017856 00000100:00100000:2.0:1787602627.102203:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787602627.102211:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874436839017856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602627.102244:0:15066:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602627.102285:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874436839017856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602627.102292:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787602627.102323:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436839018496:0@lo:400:kworker.0 00000100:00100000:2.0:1787602627.102348:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602627.102374:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839018496 00000100:00100000:2.0:1787602627.102377:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839018496 00000100:00100000:1.0:1787602627.102512:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787602627.102519:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436839017984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602627.102536:0:15067:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602627.102570:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874436839017984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602627.102576:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787602627.102593:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436839018240:0@lo:400:kworker.0 00000100:00100000:1.0:1787602627.102615:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602627.102648:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874436839017856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602627.102661:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602627.102666:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff944a7c52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436839018368:0@lo:400:kworker.0 00000100:00100000:1.0:1787602627.102685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602627.102707:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839018240 00000100:00100000:1.0:1787602627.102711:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839018240 00000100:00100000:1.0:1787602627.102732:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839018368 00000100:00100000:1.0:1787602627.102735:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839018368 00000100:00100000:2.0:1787602627.102798:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602627.102806:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436839018240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602627.102853:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874436839018240:12345-0@lo:400:kworker.0 Request processed in 37us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602627.102859:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602627.102872:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787602627.102878:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436839018496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602627.102905:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874436839018496:12345-0@lo:400:kworker.0 Request processed in 27us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602627.102910:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787602627.102947:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787602627.102951:0:14374:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602627.102981:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874436839018496:0@lo:400:kworker.0 00000100:00100000:2.0:1787602627.102995:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a752d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874436839017984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602627.103234:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874436839018240:0@lo:400:kworker.0 00000100:00100000:0.0:1787602627.103371:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436839018112 00000100:00100000:0.0:1787602627.103376:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436839018112 00000100:00100000:0.0:1787602627.103410:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787602627.103418:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944944b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:3312:x1874436839018112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602627.103460:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944944b23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0c3bd976-3721-4ec4-bd04-79d86542b9eb+19:3312:x1874436839018112:12345-0@lo:400:kworker.0 Request processed in 43us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602627.103466:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787602627.103535:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0c3bd976-3721-4ec4-bd04-79d86542b9eb:3312:1874436839018112:0@lo:400:kworker.0 00000100:00100000:2.0:1787602627.103914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:2.0:1787602627.103965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602627.104052:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821216128 00000100:00100000:0.0:1787602627.104056:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821216128 00000100:00100000:0.0:1787602627.104097:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821216000 00000100:00100000:0.0:1787602627.104100:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821216000 00000100:00100000:0.0:1787602627.104117:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:0.0:1787602627.104124:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4d743acf-bd40-44c9-89fb-11535243145c+8:2362:x1874436821216128:12345-192.168.206.25@tcp:4:dd.0 00002000:00010000:0.0:1787602627.104161:0:15069:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8ca6c1, atime: 0x6a8ca6c0, ctime: 0x6a8ca6c1, blocks: 0x1 00010000:00010000:0.0:1787602627.104177:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aa62a97/0x576b7af90af47f15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.104194:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787602627.104198:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602627.104204:0:15069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aa62a97/0x576b7af90af47f15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.104222:0:15069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aa62a97/0x576b7af90af47f15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602627.105459:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787602627.105475:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a6e948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436839018368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602627.105554:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a6e948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874436839018368:12345-0@lo:400:kworker.0 Request processed in 80us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602627.105562:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787602627.105623:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff944a7c52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874436839018368:0@lo:400:kworker.0 00000100:00100000:0.0:1787602627.107759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:0.0:1787602627.107899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602627.108636:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787602627.108771:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787602627.108967:0:15068:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787602627.109220:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821216384 00000100:00100000:3.0:1787602627.109230:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821216384 00000100:00100000:3.0:1787602627.109278:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787602627.109288:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821216256 00000100:00100000:3.0:1787602627.109291:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821216256 00000100:00100000:1.0:1787602627.110661:0:16609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:3.0:1787602627.110662:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:1.0:1787602627.110683:0:16609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a752d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4d743acf-bd40-44c9-89fb-11535243145c+11:2362:x1874436821216000:12345-192.168.206.25@tcp:4:dd.0 00000100:00100000:3.0:1787602627.110698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00000100:00100000:3.0:1787602627.110715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00010000:00010000:1.0:1787602627.110723:0:16609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066badc41/0x576b7af90af47f1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602627.110735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.25@tcp (source: 12345-192.168.206.25@tcp) 00010000:00010000:1.0:1787602627.110739:0:16609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602627.110744:0:16609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602627.110750:0:16609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066badc41/0x576b7af90af47f1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602627.110755:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787602627.110763:0:15068:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00010000:00010000:1.0:1787602627.110805:0:16609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066badc41/0x576b7af90af47f1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602627.110889:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821216640 00000100:00100000:3.0:1787602627.110895:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821216640 00000100:00100000:3.0:1787602627.110927:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787602627.110934:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821216512 00000100:00100000:3.0:1787602627.110937:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821216512 00000100:00100000:3.0:1787602627.110958:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787602627.110965:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821216896 00000100:00100000:3.0:1787602627.110968:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821216896 00000100:00100000:3.0:1787602627.110987:0:15068:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787602627.110993:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436821216768 00000100:00100000:3.0:1787602627.110996:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436821216768 00000100:00100000:3.0:1787602627.111338:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:3.0:1787602627.111347:0:16610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4d743acf-bd40-44c9-89fb-11535243145c+15:2362:x1874436821216384:12345-192.168.206.25@tcp:4:dd.0 00000100:00100000:2.0:1787602627.111368:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00010000:00010000:3.0:1787602627.111369:0:16610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074803dc1/0x576b7af90af47f23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602627.111381:0:16610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602627.111391:0:16610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602627.111396:0:16610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074803dc1/0x576b7af90af47f23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602627.111408:0:16610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074803dc1/0x576b7af90af47f23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602627.113122:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:2.0:1787602627.113136:0:16611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4d743acf-bd40-44c9-89fb-11535243145c+16:2362:x1874436821216256:12345-192.168.206.25@tcp:4:dd.0 00010000:00010000:2.0:1787602627.113241:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47f2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.113258:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602627.113262:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602627.113268:0:16611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47f2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.113281:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47f2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602627.233930:0:15069:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787602627.233938:0:15069:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787602625 -> 1787602626 00002000:00010000:2.0:1787602627.233941:0:15069:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787602625 -> 1787602626 00002000:00010000:2.0:1787602627.233944:0:15069:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1787602627.233966:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000aa62a97/0x576b7af90af47f15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.233980:0:15069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000aa62a97/0x576b7af90af47f15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.234008:0:15069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000aa62a97/0x576b7af90af47f15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.234015:0:15069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c459c00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602627.234019:0:15069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000aa62a97/0x576b7af90af47f15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.234029:0:15069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000aa62a97/0x576b7af90af47f15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.234063:0:15069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000aa62a97/0x576b7af90af47f15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.234071:0:15069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aa62a97/0x576b7af90af47f15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602627.234161:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4d743acf-bd40-44c9-89fb-11535243145c+25:2362:x1874436821216128:12345-192.168.206.25@tcp:4:dd.0 Request processed in 130033us (130244us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787602627.234171:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 0 00000100:00100000:2.0:1787602627.234201:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 4 00000100:00100000:2.0:1787602627.234212:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4d743acf-bd40-44c9-89fb-11535243145c+24:2362:x1874436821216640:12345-192.168.206.25@tcp:4:dd.0 00010000:00010000:2.0:1787602627.234240:0:15069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f0bafc/0x576b7af90af47f31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.234251:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602627.234261:0:15069:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602627.234267:0:15069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f0bafc/0x576b7af90af47f31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.234278:0:15069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1f0bafc/0x576b7af90af47f31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787602627.235442:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:0.0:1787602627.235610:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:0.0:1787602627.235620:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1787602627.235628:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00010000:00010000:3.0:1787602627.293115:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602627.293814:0:16610:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:2.0:1787602627.293820:0:16610:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 8199 00010000:00010000:2.0:1787602627.293833:0:16610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074803dc1/0x576b7af90af47f23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.293845:0:16610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074803dc1/0x576b7af90af47f23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.293854:0:16610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074803dc1/0x576b7af90af47f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.293869:0:16610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a47d71800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602627.293873:0:16610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074803dc1/0x576b7af90af47f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.293882:0:16610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074803dc1/0x576b7af90af47f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.293900:0:16610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074803dc1/0x576b7af90af47f23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.293931:0:16610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074803dc1/0x576b7af90af47f23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602627.294021:0:16610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4d743acf-bd40-44c9-89fb-11535243145c+22:2362:x1874436821216384:12345-192.168.206.25@tcp:4:dd.0 Request processed in 182671us (186265us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787602627.294030:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 2 00000100:00100000:2.0:1787602627.294088:0:16610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 5 00000100:00100000:2.0:1787602627.294099:0:16610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4d743acf-bd40-44c9-89fb-11535243145c+21:2362:x1874436821216512:12345-192.168.206.25@tcp:4:dd.0 00010000:00010000:2.0:1787602627.294126:0:16610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47f38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.294137:0:16610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602627.294142:0:16610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602627.294147:0:16610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47f38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.294158:0:16610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47f38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602627.294263:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1787602627.296753:0:16611:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1787602627.296787:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47f2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602627.296800:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47f2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602627.296809:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602627.296831:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610a600 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:1.0:1787602627.296836:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602627.296845:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602627.296875:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47f2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602627.296882:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1a0eec4/0x576b7af90af47f2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602627.296966:0:16611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4d743acf-bd40-44c9-89fb-11535243145c+15:2362:x1874436821216256:12345-192.168.206.25@tcp:4:dd.0 Request processed in 183830us (189063us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787602627.296976:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 3 00000100:00100000:1.0:1787602627.297009:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 6 00000100:00100000:1.0:1787602627.297021:0:16611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4d743acf-bd40-44c9-89fb-11535243145c+14:2362:x1874436821216896:12345-192.168.206.25@tcp:4:dd.0 00010000:00010000:1.0:1787602627.297074:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e41bf2e8/0x576b7af90af47f3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602627.297086:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602627.297090:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602627.297095:0:16611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e41bf2e8/0x576b7af90af47f3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602627.297118:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e41bf2e8/0x576b7af90af47f3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.298006:0:16609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066badc41/0x576b7af90af47f1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.298018:0:16609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066badc41/0x576b7af90af47f1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.298026:0:16609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066badc41/0x576b7af90af47f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.298033:0:16609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41486800 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602627.298068:0:16609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066badc41/0x576b7af90af47f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.298084:0:16609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066badc41/0x576b7af90af47f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.298099:0:16609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066badc41/0x576b7af90af47f1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.298105:0:16609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066badc41/0x576b7af90af47f1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602627.298159:0:16609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a752d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4d743acf-bd40-44c9-89fb-11535243145c+14:2362:x1874436821216000:12345-192.168.206.25@tcp:4:dd.0 Request processed in 187484us (194193us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787602627.298167:0:16609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 1 00000100:00100000:0.0:1787602627.298187:0:16609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:0.0:1787602627.298196:0:16609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff944a7c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4d743acf-bd40-44c9-89fb-11535243145c+13:2362:x1874436821216768:12345-192.168.206.25@tcp:4:dd.0 00010000:00010000:0.0:1787602627.298215:0:16609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af47f46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.298239:0:16609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602627.298242:0:16609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602627.298247:0:16609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af47f46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.298256:0:16609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af47f46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602627.340536:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:2.0:1787602627.346102:0:15069:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1787602627.346112:0:15069:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1787602627.346131:0:15069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f0bafc/0x576b7af90af47f31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.346160:0:15069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f0bafc/0x576b7af90af47f31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.346169:0:15069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1f0bafc/0x576b7af90af47f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.346176:0:15069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610be00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602627.346180:0:15069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f0bafc/0x576b7af90af47f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.346189:0:15069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f0bafc/0x576b7af90af47f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.346208:0:15069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1f0bafc/0x576b7af90af47f31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.346216:0:15069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1f0bafc/0x576b7af90af47f31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602627.346304:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4d743acf-bd40-44c9-89fb-11535243145c+17:2362:x1874436821216640:12345-192.168.206.25@tcp:4:dd.0 Request processed in 112090us (235640us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787602627.346314:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 4 00002000:00010000:2.0:1787602627.378713:0:16610:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1787602627.378733:0:16610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47f38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.378762:0:16610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47f38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.378771:0:16610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47f38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.378789:0:16610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94494610ac00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602627.378795:0:16610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47f38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.378804:0:16610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47f38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.378823:0:16610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47f38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.378831:0:16610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4ce63b9/0x576b7af90af47f38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602627.378921:0:16610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4d743acf-bd40-44c9-89fb-11535243145c+15:2362:x1874436821216512:12345-192.168.206.25@tcp:4:dd.0 Request processed in 84820us (268218us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787602627.378931:0:16610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 5 00000001:00080000:2.0:1787602627.378967:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:2.0:1787602627.378982:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1787602627.379537:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e41bf2e8/0x576b7af90af47f3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.379548:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e41bf2e8/0x576b7af90af47f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.379555:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e41bf2e8/0x576b7af90af47f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.379562:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a41487e00 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:0.0:1787602627.379565:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e41bf2e8/0x576b7af90af47f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.379573:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e41bf2e8/0x576b7af90af47f3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.379584:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e41bf2e8/0x576b7af90af47f3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602627.379592:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e41bf2e8/0x576b7af90af47f3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.379709:0:16609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af47f46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.379725:0:16609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af47f46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.379732:0:16609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af47f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.379738:0:16609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff944a7c458400 already unused, calling callback (ffffffffc16c9230) 00010000:00010000:2.0:1787602627.379741:0:16609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af47f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.379748:0:16609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af47f46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.379759:0:16609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af47f46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602627.379766:0:16609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000668e7205/0x576b7af90af47f46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602627.379818:0:16609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4d743acf-bd40-44c9-89fb-11535243145c+6:2362:x1874436821216768:12345-192.168.206.25@tcp:4:dd.0 Request processed in 81622us (269080us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787602627.379826:0:16609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 7 00000100:00100000:0.0:1787602627.380456:0:16611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff944a7c52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4d743acf-bd40-44c9-89fb-11535243145c+5:2362:x1874436821216896:12345-192.168.206.25@tcp:4:dd.0 Request processed in 83437us (269738us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787602627.380465:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.25@tcp, seq: 6 00010000:00010000:0.0:1787602628.318692:0:15844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787602628.824458:0:16650:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787602629.341206:0:14367:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28715 lines, 28715 kept, 0 dropped, 0 bad.